Jul 01 03:51:46 devstack cinder-volume[74540]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 01 03:51:46 devstack cinder-volume[74540]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 01 03:51:46 devstack cinder-volume[74540]: we strongly recommend against using it for new projects. Jul 01 03:51:46 devstack cinder-volume[74540]: If you are already using Eventlet, we recommend migrating to a different Jul 01 03:51:46 devstack cinder-volume[74540]: framework. For more detail see Jul 01 03:51:46 devstack cinder-volume[74540]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 01 03:51:46 devstack cinder-volume[74540]: import eventlet # noqa Jul 01 03:51:48 devstack cinder-volume[74540]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 01 03:51:48 devstack cinder-volume[74540]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 01 03:51:48 devstack cinder-volume[74540]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 01 03:51:49 devstack cinder-volume[74540]: INFO dbcounter [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Registered counter for database cinder Jul 01 03:51:49 devstack cinder-volume[74540]: DEBUG oslo_db.sqlalchemy.engines [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74540) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 03:51:50 devstack cinder-volume[74540]: DEBUG dbcounter [-] [74540] Writer thread running {{(pid=74540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 01 03:51:50 devstack cinder-volume[74540]: INFO cinder.rpc [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 01 03:51:50 devstack cinder-volume[74540]: INFO cinder.rpc [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 01 03:51:50 devstack cinder-volume[74540]: DEBUG oslo_db.sqlalchemy.engines [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74540) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 03:51:50 devstack cinder-volume[74540]: INFO cinder.volume.manager [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Determined volume DB was empty at startup. Jul 01 03:51:50 devstack cinder-volume[74540]: DEBUG cinder.volume.manager [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74540) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 01 03:51:50 devstack cinder-volume[74540]: INFO cinder.volume.manager [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 01 03:51:50 devstack cinder-volume[74540]: WARNING stevedore.named [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 01 03:51:50 devstack cinder-volume[74540]: WARNING castellan.key_manager [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 01 03:51:50 devstack cinder-volume[74540]: WARNING cinder.keymgr.conf_key_mgr [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 01 03:51:50 devstack cinder-volume[74540]: DEBUG cinder.volume.drivers.lvm [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74540) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 01 03:51:50 devstack cinder-volume[74540]: DEBUG oslo_concurrency.processutils [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:50 devstack cinder-volume[74540]: DEBUG oslo_concurrency.processutils [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] CMD "cinder-rtstool verify" returned: 0 in 0.523s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:50 devstack cinder-volume[74540]: DEBUG oslo_db.sqlalchemy.engines [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74540) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 03:51:50 devstack cinder-volume[74540]: INFO cinder.rpc [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 01 03:51:50 devstack cinder-volume[74540]: INFO cinder.rpc [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 01 03:51:50 devstack cinder-volume[74540]: WARNING stevedore.named [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 01 03:51:50 devstack cinder-volume[74540]: WARNING castellan.key_manager [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 01 03:51:50 devstack cinder-volume[74540]: INFO cinder.volume.manager [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_db.sqlalchemy.engines [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74540) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 03:51:51 devstack cinder-volume[74540]: INFO oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Starting 1 workers Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Started child 74717 {{(pid=74540) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Full set of CONF: {{(pid=74540) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] ******************************************************************************** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Configuration options gathered from: {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] ================================================================================ {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] allow_availability_zone_fallback = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] allow_compression_on_image_upload = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] allowed_direct_url_schemes = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] api_rate_limit = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] auth_strategy = keystone {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] az_cache_duration = 3600 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_availability_zone = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_host = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_name = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_stats_polling_interval = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backup_api_class = cinder.backup.api.API {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backup_name_template = backup-%s {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backup_use_same_host = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backup_use_temp_snapshot = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] chap_password = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] chap_username = {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cinder_internal_tenant_project_id = e437ca00bb2f42a3ab87c2d64d852553 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cinder_internal_tenant_user_id = fdd579b2b0ac4376bf2f124c4a100e70 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cloned_volume_same_az = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cluster = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] compression_format = gzip {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74717]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] compute_api_class = cinder.compute.nova.API {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] config_dir = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] config_source = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] control_exchange = openstack {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] debug = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] default_availability_zone = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] default_group_type = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] default_volume_type = lvmdriver-1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] disk_geometry = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] driver_client_cert = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] driver_client_cert_key = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] driver_data_namespace = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] driver_ssl_cert_path = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] driver_ssl_cert_verify = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] driver_use_ssl = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] enable_force_upload = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] enable_new_services = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] enable_unsupported_driver = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] enabled_backends = ['lvmdriver-1'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] enforce_multipath_for_image_xfer = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] filter_function = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance_api_insecure = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance_api_servers = ['http://192.168.122.240/image'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance_api_ssl_compression = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance_ca_certificates_file = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance_catalog_info = image:glance:publicURL {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance_certfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance_keyfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance_num_retries = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance_request_timeout = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] goodness_function = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] graceful_shutdown_timeout = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] group_api_class = cinder.group.api.API {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] host = devstack {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] image_compress_on_upload = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] image_conversion_address_space_limit = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] image_conversion_cpu_limit = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] image_conversion_disable = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] image_upload_use_cinder_backend = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] image_upload_use_internal_tenant = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] image_volume_cache_enabled = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] image_volume_cache_max_count = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] image_volume_cache_max_size_gb = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] init_host_max_objects_retrieval = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] instance_format = [instance: %(uuid)s] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] iscsi_target_flags = {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] iscsi_write_cache = on {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] iser_helper = tgtadm {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] iser_ip_address = 192.168.122.240 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] iser_port = 3260 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] log_color = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] log_config_append = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] log_dir = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] log_file = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] log_options = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] log_rotate_interval = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] log_rotate_interval_type = days {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] log_rotation_type = none {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] max_age = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] max_logfile_count = 30 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] max_logfile_size_mb = 200 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] max_over_subscription_ratio = 20.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] message_reap_interval = 86400 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] message_ttl = 2592000 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] migration_create_volume_timeout_secs = 300 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] monkey_patch = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] monkey_patch_modules = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] my_ip = 192.168.122.240 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] no_snapshot_gb_quota = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] num_iser_scan_tries = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] num_shell_tries = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] num_volume_device_scan_tries = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] nvmeof_conn_info_version = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] nvmet_ns_id = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] nvmet_port_id = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] osapi_max_limit = 1000 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] osapi_volume_ext_list = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] osapi_volume_listen = 0.0.0.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] osapi_volume_listen_port = 8776 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] osapi_volume_use_ssl = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] osapi_volume_workers = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] per_volume_size_limit = -1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] periodic_fuzzy_delay = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] periodic_interval = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] project_id_regex = [0-9a-f\-]+ {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] public_endpoint = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] publish_errors = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] quota_backup_gigabytes = 1000 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] quota_backups = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] quota_gigabytes = 1000 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] quota_groups = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] quota_snapshots = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] quota_volumes = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] rate_limit_burst = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] rate_limit_except_level = CRITICAL {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] rate_limit_interval = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] reinit_driver_count = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] replication_device = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] report_discard_supported = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] report_interval = 120 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] reservation_clean_interval = 86400 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] reservation_expire = 86400 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] reserved_image_namespaces = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] reserved_percentage = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] rpc_response_timeout = 120 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] run_external_periodic_tasks = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] scst_target_driver = iscsi {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] scst_target_iqn_name = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] service_down_time = 720 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] shell_completion = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] snapshot_name_template = snapshot-%s {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] snapshot_same_host = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] split_loggers = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] state_path = /opt/stack/data/cinder {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] storage_availability_zone = nova {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] storage_protocol = iSCSI {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] syslog_log_facility = LOG_USER {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] target_helper = lioadm {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] target_ip_address = 192.168.122.240 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] target_port = 3260 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] target_protocol = iscsi {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] target_secondary_ip_addresses = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] trace_flags = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] transfer_api_class = cinder.transfer.api.API {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] transport_url = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] until_refresh = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] use_chap_auth = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] use_default_quota_class = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] use_journal = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] use_json = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] use_multipath_for_image_xfer = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] use_stderr = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] use_syslog = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] verify_glance_signatures = enabled {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74717]: INFO cinder.volume.manager [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] volume_api_class = cinder.volume.api.API {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] volume_backend_name = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] volume_clear = zero {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] volume_clear_ionice = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] volume_clear_size = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] volume_copy_bps_limit = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] volume_dd_blocksize = 1M {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] volume_name_template = volume-%s {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] volume_service_inithost_offload = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] volume_usage_audit_period = month {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] zoning_mode = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_concurrency.disable_process_locking = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.auth_section = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.auth_type = password {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.auth_version = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.cache = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.certfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.include_service_catalog = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.insecure = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.interface = public {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.keyfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_password = {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcache_username = {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.region_name = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.service_token_roles_required = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.service_type = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.240/identity {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.backend = dogpile.cache.null {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.backend_argument = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.backend_expiration_time = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.config_prefix = cache.oslo {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.debug_cache_backend = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.enable_retry_client = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.enable_socket_keepalive = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.enabled = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.expiration_time = 600 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.hashclient_retry_attempts = 2 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.memcache_dead_retry = 300 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.memcache_pool_maxsize = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.memcache_sasl_enabled = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.password = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.proxies = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.redis_db = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.redis_server = localhost:6379 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.retry_attempts = 2 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.retry_delay = 0.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.socket_keepalive_count = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.socket_keepalive_idle = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.socket_keepalive_interval = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.socket_timeout = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.tls_allowed_ciphers = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.tls_cafile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.tls_certfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:51 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.tls_enabled = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.tls_keyfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cache.username = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] coordination.backend_url = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.asyncio_connection = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.asyncio_slave_connection = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.backend = sqlalchemy {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.connection = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.connection_debug = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.connection_parameters = {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.connection_recycle_time = 3600 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.connection_trace = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.db_inc_retry_interval = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.db_max_retries = 20 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.db_max_retry_interval = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.db_retry_interval = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.max_overflow = 50 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.max_pool_size = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.max_retries = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.mysql_wsrep_sync_wait = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.pool_timeout = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.retry_interval = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.slave_connection = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.sqlite_synchronous = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.synchronous_reader = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] database.use_db_reconnect = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] profiler.connection_string = messaging:// {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] profiler.enabled = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] profiler.es_doc_type = notification {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] profiler.es_scroll_size = 10000 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] profiler.es_scroll_time = 2m {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] profiler.filter_error_trace = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] profiler.hmac_keys = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] profiler.sentinel_service_name = mymaster {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] profiler.socket_timeout = 0.1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] profiler.trace_requests = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] profiler.trace_sqlalchemy = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] profiler_jaeger.process_tags = {} {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] profiler_jaeger.service_name_prefix = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] profiler_otlp.service_name_prefix = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_policy.enforce_new_defaults = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_policy.enforce_scope = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_policy.policy_default_rule = default {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_policy.policy_file = policy.yaml {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_policy.remote_timeout = 60.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] privsep_osbrick.group = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] privsep_osbrick.helper_command = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] privsep_osbrick.user = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cinder_sys_admin.group = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cinder_sys_admin.helper_command = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] cinder_sys_admin.user = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] service_user.auth_section = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] service_user.auth_type = password {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] service_user.cafile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] service_user.certfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] service_user.collect_timing = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] service_user.insecure = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] service_user.keyfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] service_user.send_service_user_token = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] service_user.split_loggers = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] service_user.timeout = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance.auth_section = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance.auth_type = password {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance.certfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance.collect_timing = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance.insecure = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance.keyfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance.region_name = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance.split_loggers = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] glance.timeout = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.backend_availability_zone = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.chap_password = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.chap_username = {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.disk_geometry = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.driver_client_cert = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.driver_client_cert_key = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.driver_data_namespace = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.driver_use_ssl = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.extra_capabilities = {} {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.filter_function = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.goodness_function = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.iscsi_target_flags = {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.iscsi_write_cache = on {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.iser_helper = tgtadm {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.iser_ip_address = 192.168.122.240 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.iser_port = 3260 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack sudo[74722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.lvm_mirrors = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.lvm_share_target = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.lvm_type = auto {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.num_shell_tries = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.replication_device = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.report_discard_supported = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.reserved_percentage = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack sudo[74722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.target_helper = tgtadm {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.target_ip_address = 192.168.122.240 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.target_port = 3260 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.target_protocol = iscsi {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.trace_flags = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.unique_fqdn_network = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.use_chap_auth = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.volume_backend_name = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.volume_clear = zero {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.volume_clear_ionice = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.volume_clear_size = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.volume_group = cinder-volumes {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_reports.file_event_handler = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_reports.log_dir = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.backend_host = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.chap_password = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.chap_username = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.chiscsi_conf = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.disk_geometry = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.driver_client_cert = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.driver_use_ssl = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.extra_capabilities = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.filter_function = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.goodness_function = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.iser_helper = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.iser_ip_address = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.iser_port = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.lvm_conf_file = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.lvm_mirrors = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.lvm_share_target = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.lvm_type = auto {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.num_shell_tries = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.nvmet_port_id = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.replication_device = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.report_discard_supported = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.reserved_percentage = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.scst_target_driver = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.storage_protocol = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.target_helper = lioadm {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.target_ip_address = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.target_port = 3260 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.target_protocol = iscsi {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.trace_flags = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.use_chap_auth = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.volume_clear = zero {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.volume_clear_size = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] lvmdriver-1.volumes_dir = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.ssl = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.ssl_version = {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_notifications.driver = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_notifications.retry = -1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] key_manager.fixed_key = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.barbican_api_version = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.barbican_endpoint = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.barbican_endpoint_type = public {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.barbican_region_name = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.cafile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.certfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.collect_timing = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.insecure = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.keyfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.number_of_retries = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.retry_delay = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.send_service_user_token = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.split_loggers = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.timeout = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.verify_ssl = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican.verify_ssl_path = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican_service_user.auth_section = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican_service_user.auth_type = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican_service_user.cafile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican_service_user.certfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican_service_user.collect_timing = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican_service_user.insecure = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican_service_user.keyfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican_service_user.split_loggers = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] barbican_service_user.timeout = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] vault.approle_role_id = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] vault.approle_secret_id = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] vault.kv_mountpoint = secret {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] vault.kv_path = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] vault.kv_version = 2 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] vault.namespace = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] vault.root_token_id = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] vault.ssl_ca_crt_file = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] vault.timeout = 60.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] vault.use_ssl = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:51:51 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] ******************************************************************************** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 01 03:51:52 devstack sudo[74722]: pam_unix(sudo:session): session closed for user root Jul 01 03:51:52 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.711s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:52 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:52 devstack sudo[74901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 03:51:52 devstack sudo[74901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:51:52 devstack sudo[74901]: pam_unix(sudo:session): session closed for user root Jul 01 03:51:52 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.667s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:52 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 03:51:52 devstack cinder-volume[74717]: INFO cinder.brick.local_dev.lvm [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 01 03:51:52 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:52 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:52 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:52 devstack sudo[75124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 03:51:52 devstack sudo[75124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:51:53 devstack sudo[75124]: pam_unix(sudo:session): session closed for user root Jul 01 03:51:53 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:53 devstack cinder-volume[74717]: DEBUG cinder.brick.local_dev.lvm [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=74717) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 01 03:51:53 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:53 devstack sudo[75288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 03:51:53 devstack sudo[75288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:51:54 devstack sudo[75288]: pam_unix(sudo:session): session closed for user root Jul 01 03:51:54 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.007s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:54 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:54 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:54 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:54 devstack sudo[75446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 03:51:54 devstack sudo[75446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:51:55 devstack sudo[75446]: pam_unix(sudo:session): session closed for user root Jul 01 03:51:55 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.768s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:55 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:55 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:55 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:55 devstack sudo[75501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 01 03:51:55 devstack sudo[75501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:51:55 devstack sudo[75501]: pam_unix(sudo:session): session closed for user root Jul 01 03:51:56 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.651s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:56 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:56 devstack sudo[75505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 03:51:56 devstack sudo[75505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:51:56 devstack sudo[75505]: pam_unix(sudo:session): session closed for user root Jul 01 03:51:56 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:56 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:56 devstack sudo[75515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 03:51:56 devstack sudo[75515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:51:57 devstack sudo[75515]: pam_unix(sudo:session): session closed for user root Jul 01 03:51:57 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.938s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:57 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:57 devstack sudo[75522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 03:51:57 devstack sudo[75522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:51:58 devstack sudo[75522]: pam_unix(sudo:session): session closed for user root Jul 01 03:51:58 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.820s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:58 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:58 devstack sudo[75527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 03:51:58 devstack sudo[75527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:51:59 devstack sudo[75527]: pam_unix(sudo:session): session closed for user root Jul 01 03:51:59 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.736s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:59 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:59 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:59 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:59 devstack sudo[75532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 03:51:59 devstack sudo[75532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:51:59 devstack sudo[75532]: pam_unix(sudo:session): session closed for user root Jul 01 03:51:59 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.784s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:59 devstack cinder-volume[74717]: INFO cinder.volume.drivers.lvm [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 01 03:51:59 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:59 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:51:59 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:51:59 devstack sudo[75545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 03:51:59 devstack sudo[75545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:52:00 devstack sudo[75545]: pam_unix(sudo:session): session closed for user root Jul 01 03:52:00 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.790s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:52:00 devstack cinder-volume[74717]: DEBUG cinder.volume.drivers.lvm [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Updating volume stats {{(pid=74717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 01 03:52:00 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:52:00 devstack sudo[75662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 03:52:00 devstack sudo[75662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:52:01 devstack cinder-volume[74540]: DEBUG dbcounter [-] [74540] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 03:52:01 devstack sudo[75662]: pam_unix(sudo:session): session closed for user root Jul 01 03:52:01 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:52:01 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:52:01 devstack sudo[75803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 03:52:01 devstack sudo[75803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:52:02 devstack sudo[75803]: pam_unix(sudo:session): session closed for user root Jul 01 03:52:02 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:52:02 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:52:02 devstack sudo[75806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 03:52:02 devstack sudo[75806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:52:02 devstack sudo[75806]: pam_unix(sudo:session): session closed for user root Jul 01 03:52:02 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:52:02 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:52:02 devstack sudo[75810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 03:52:02 devstack sudo[75810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:52:03 devstack sudo[75810]: pam_unix(sudo:session): session closed for user root Jul 01 03:52:03 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:52:03 devstack cinder-volume[74717]: INFO cinder.volume.driver [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Driver hasn't implemented _init_vendor_properties() Jul 01 03:52:03 devstack cinder-volume[74717]: DEBUG cinder.volume.driver [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=74717) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 01 03:52:03 devstack cinder-volume[74717]: DEBUG oslo_db.sqlalchemy.engines [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74717) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 03:52:03 devstack cinder-volume[74717]: DEBUG dbcounter [-] [74717] Writer thread running {{(pid=74717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 01 03:52:03 devstack cinder-volume[74717]: DEBUG cinder.db.api [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Building query based on filter {{(pid=74717) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 01 03:52:03 devstack cinder-volume[74717]: DEBUG cinder.image.image_utils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=74717) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 01 03:52:03 devstack cinder-volume[74717]: INFO cinder.keymgr.migration [None req-b1326548-8a82-4f63-be46-b234b4c46e29 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 01 03:52:03 devstack cinder-volume[74717]: DEBUG cinder.volume.drivers.lvm [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Updating volume stats {{(pid=74717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 01 03:52:03 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:52:03 devstack sudo[75814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 03:52:03 devstack sudo[75814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:52:04 devstack sudo[75814]: pam_unix(sudo:session): session closed for user root Jul 01 03:52:04 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:52:04 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:52:04 devstack sudo[75826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 03:52:04 devstack sudo[75826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:52:04 devstack sudo[75826]: pam_unix(sudo:session): session closed for user root Jul 01 03:52:04 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:52:04 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:52:04 devstack sudo[75830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 03:52:04 devstack sudo[75830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:52:05 devstack sudo[75830]: pam_unix(sudo:session): session closed for user root Jul 01 03:52:05 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.671s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:52:05 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:52:05 devstack sudo[75834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 03:52:05 devstack sudo[75834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:52:06 devstack sudo[75834]: pam_unix(sudo:session): session closed for user root Jul 01 03:52:06 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:52:06 devstack cinder-volume[74717]: DEBUG cinder.manager [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Notifying Schedulers of capabilities ... {{(pid=74717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 03:52:06 devstack cinder-volume[74717]: INFO cinder.volume.manager [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Driver initialization completed successfully. Jul 01 03:52:06 devstack cinder-volume[74717]: INFO cinder.manager [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Initiating service 2 cleanup Jul 01 03:52:06 devstack cinder-volume[74717]: INFO cinder.manager [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Service 2 cleanup completed. Jul 01 03:52:06 devstack cinder-volume[74717]: DEBUG cinder.service [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Creating RPC server for service cinder-volume {{(pid=74717) start /opt/stack/cinder/cinder/service.py:231}} Jul 01 03:52:06 devstack cinder-volume[74717]: DEBUG cinder.service [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=74717) start /opt/stack/cinder/cinder/service.py:237}} Jul 01 03:52:06 devstack cinder-volume[74717]: INFO cinder.volume.manager [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 01 03:52:06 devstack cinder-volume[74717]: DEBUG cinder.volume.drivers.lvm [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Updating volume stats {{(pid=74717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 01 03:52:06 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:52:06 devstack sudo[75838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 03:52:06 devstack sudo[75838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:52:07 devstack sudo[75838]: pam_unix(sudo:session): session closed for user root Jul 01 03:52:07 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:52:07 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:52:07 devstack sudo[75841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 03:52:07 devstack sudo[75841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:52:07 devstack sudo[75841]: pam_unix(sudo:session): session closed for user root Jul 01 03:52:07 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:52:07 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:52:07 devstack sudo[75902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 03:52:07 devstack sudo[75902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:52:08 devstack sudo[75902]: pam_unix(sudo:session): session closed for user root Jul 01 03:52:08 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.688s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:52:08 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:52:08 devstack sudo[75905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 03:52:08 devstack sudo[75905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:52:09 devstack sudo[75905]: pam_unix(sudo:session): session closed for user root Jul 01 03:52:09 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:52:09 devstack cinder-volume[74717]: INFO cinder.volume.manager [None req-860a1f31-f4c2-40e6-9028-43021c38fec3 None None] Driver post RPC initialization completed successfully. Jul 01 03:52:09 devstack cinder-volume[74717]: DEBUG oslo_service.periodic_task [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running periodic task VolumeManager._thread_info {{(pid=74717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 03:52:09 devstack cinder-volume[74717]: DEBUG cinder.volume.manager [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] thread count: 6 {{(pid=74717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 03:52:09 devstack cinder-volume[74717]: DEBUG cinder.volume.manager [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] thread info: [<_MainThread(MainThread, started 125476798562432)>, , , , , ] {{(pid=74717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 03:52:19 devstack cinder-volume[74717]: DEBUG dbcounter [-] [74717] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 03:52:19 devstack cinder-volume[74717]: DEBUG dbcounter [-] [74717] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=74717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 03:53:09 devstack cinder-volume[74717]: DEBUG oslo_service.periodic_task [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 03:53:09 devstack cinder-volume[74717]: DEBUG cinder.volume.drivers.lvm [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Updating volume stats {{(pid=74717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 01 03:53:09 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:53:09 devstack sudo[77639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 03:53:09 devstack sudo[77639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:53:09 devstack sudo[77639]: pam_unix(sudo:session): session closed for user root Jul 01 03:53:09 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:53:09 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:53:09 devstack sudo[77642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 03:53:09 devstack sudo[77642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:53:10 devstack sudo[77642]: pam_unix(sudo:session): session closed for user root Jul 01 03:53:10 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:53:10 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:53:10 devstack sudo[77645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 03:53:10 devstack sudo[77645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:53:11 devstack sudo[77645]: pam_unix(sudo:session): session closed for user root Jul 01 03:53:11 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.628s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:53:11 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:53:11 devstack sudo[77666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 03:53:11 devstack sudo[77666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:53:11 devstack sudo[77666]: pam_unix(sudo:session): session closed for user root Jul 01 03:53:11 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:53:11 devstack cinder-volume[74717]: DEBUG cinder.manager [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Notifying Schedulers of capabilities ... {{(pid=74717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 03:53:11 devstack cinder-volume[74717]: DEBUG oslo_service.periodic_task [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running periodic task VolumeManager._thread_info {{(pid=74717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 03:53:11 devstack cinder-volume[74717]: DEBUG cinder.volume.manager [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] thread count: 6 {{(pid=74717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 03:53:11 devstack cinder-volume[74717]: DEBUG cinder.volume.manager [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] thread info: [<_MainThread(MainThread, started 125476798562432)>, , , , , ] {{(pid=74717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 03:54:09 devstack cinder-volume[74717]: DEBUG oslo_service.periodic_task [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 03:54:09 devstack cinder-volume[74717]: DEBUG cinder.volume.drivers.lvm [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Updating volume stats {{(pid=74717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 01 03:54:09 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:54:09 devstack sudo[80945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 03:54:09 devstack sudo[80945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:54:09 devstack sudo[80945]: pam_unix(sudo:session): session closed for user root Jul 01 03:54:09 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:54:09 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:54:09 devstack sudo[80949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 03:54:09 devstack sudo[80949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:54:10 devstack sudo[80949]: pam_unix(sudo:session): session closed for user root Jul 01 03:54:10 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:54:10 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:54:10 devstack sudo[80954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 03:54:10 devstack sudo[80954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:54:11 devstack sudo[80954]: pam_unix(sudo:session): session closed for user root Jul 01 03:54:11 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.622s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:54:11 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:54:11 devstack sudo[80962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 03:54:11 devstack sudo[80962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:54:11 devstack sudo[80962]: pam_unix(sudo:session): session closed for user root Jul 01 03:54:11 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:54:11 devstack cinder-volume[74717]: DEBUG cinder.manager [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Notifying Schedulers of capabilities ... {{(pid=74717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 03:54:11 devstack cinder-volume[74717]: DEBUG oslo_service.periodic_task [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running periodic task VolumeManager._thread_info {{(pid=74717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 03:54:11 devstack cinder-volume[74717]: DEBUG cinder.volume.manager [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] thread count: 6 {{(pid=74717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 03:54:11 devstack cinder-volume[74717]: DEBUG cinder.volume.manager [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] thread info: [<_MainThread(MainThread, started 125476798562432)>, , , , , ] {{(pid=74717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 03:54:19 devstack cinder-volume[74717]: DEBUG dbcounter [-] [74717] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=74717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 03:55:09 devstack cinder-volume[74717]: DEBUG oslo_service.periodic_task [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 03:55:09 devstack cinder-volume[74717]: DEBUG cinder.volume.drivers.lvm [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Updating volume stats {{(pid=74717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 01 03:55:09 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:55:09 devstack sudo[83290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 03:55:09 devstack sudo[83290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:55:09 devstack sudo[83290]: pam_unix(sudo:session): session closed for user root Jul 01 03:55:09 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:55:09 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:55:09 devstack sudo[83304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 03:55:09 devstack sudo[83304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:55:10 devstack sudo[83304]: pam_unix(sudo:session): session closed for user root Jul 01 03:55:10 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:55:10 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:55:10 devstack sudo[83328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 03:55:10 devstack sudo[83328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:55:11 devstack sudo[83328]: pam_unix(sudo:session): session closed for user root Jul 01 03:55:11 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.690s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:55:11 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:55:11 devstack sudo[83421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 03:55:11 devstack sudo[83421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:55:11 devstack sudo[83421]: pam_unix(sudo:session): session closed for user root Jul 01 03:55:11 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:55:11 devstack cinder-volume[74717]: DEBUG cinder.manager [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Notifying Schedulers of capabilities ... {{(pid=74717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 03:55:11 devstack cinder-volume[74717]: DEBUG oslo_service.periodic_task [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running periodic task VolumeManager._thread_info {{(pid=74717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 03:55:11 devstack cinder-volume[74717]: DEBUG cinder.volume.manager [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] thread count: 6 {{(pid=74717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 03:55:11 devstack cinder-volume[74717]: DEBUG cinder.volume.manager [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] thread info: [<_MainThread(MainThread, started 125476798562432)>, , , , , ] {{(pid=74717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 03:56:09 devstack cinder-volume[74717]: DEBUG oslo_service.periodic_task [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 03:56:09 devstack cinder-volume[74717]: DEBUG cinder.volume.drivers.lvm [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Updating volume stats {{(pid=74717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 01 03:56:09 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:56:09 devstack sudo[84632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 01 03:56:09 devstack sudo[84632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:56:09 devstack sudo[84632]: pam_unix(sudo:session): session closed for user root Jul 01 03:56:09 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:56:09 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:56:09 devstack sudo[84637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 03:56:09 devstack sudo[84637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:56:10 devstack sudo[84637]: pam_unix(sudo:session): session closed for user root Jul 01 03:56:10 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:56:10 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:56:10 devstack sudo[84651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 01 03:56:10 devstack sudo[84651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:56:11 devstack sudo[84651]: pam_unix(sudo:session): session closed for user root Jul 01 03:56:11 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.681s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:56:11 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:56:11 devstack sudo[84669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 01 03:56:11 devstack sudo[84669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:56:11 devstack sudo[84669]: pam_unix(sudo:session): session closed for user root Jul 01 03:56:11 devstack cinder-volume[74717]: DEBUG oslo_concurrency.processutils [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=74717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:56:11 devstack cinder-volume[74717]: DEBUG cinder.manager [None req-a22a5cb4-e9d8-4ff7-a566-08238ff2e452 None None] Notifying Schedulers of capabilities ... {{(pid=74717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 03:56:19 devstack cinder-volume[74717]: DEBUG dbcounter [-] [74717] Writing DB stats cinder:SELECT=1 {{(pid=74717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 03:56:19 devstack cinder-volume[74717]: DEBUG dbcounter [-] [74717] Writing DB stats cinder:UPDATE=1 {{(pid=74717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 03:56:32 devstack cinder-volume[74540]: INFO oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Caught SIGTERM, stopping children Jul 01 03:56:32 devstack cinder-volume[74540]: DEBUG oslo_concurrency.lockutils [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Acquiring lock "singleton_lock" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 01 03:56:32 devstack cinder-volume[74540]: DEBUG oslo_concurrency.lockutils [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Acquired lock "singleton_lock" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 01 03:56:32 devstack cinder-volume[74540]: DEBUG oslo_concurrency.lockutils [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Releasing lock "singleton_lock" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 01 03:56:32 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Stop services. {{(pid=74540) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 01 03:56:32 devstack cinder-volume[74540]: DEBUG oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Killing children. {{(pid=74540) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 01 03:56:32 devstack cinder-volume[74540]: INFO oslo_service.backend._eventlet.service [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Waiting on 1 children to exit Jul 01 03:56:37 devstack cinder-volume[74717]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 01 03:56:37 devstack cinder-volume[85185]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 01 03:56:37 devstack cinder-volume[85185]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 01 03:56:37 devstack cinder-volume[85185]: we strongly recommend against using it for new projects. Jul 01 03:56:37 devstack cinder-volume[85185]: If you are already using Eventlet, we recommend migrating to a different Jul 01 03:56:37 devstack cinder-volume[85185]: framework. For more detail see Jul 01 03:56:37 devstack cinder-volume[85185]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 01 03:56:37 devstack cinder-volume[85185]: import eventlet # noqa Jul 01 03:56:39 devstack cinder-volume[85185]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85185) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 01 03:56:39 devstack cinder-volume[85185]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85185) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 01 03:56:39 devstack cinder-volume[85185]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85185) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 01 03:56:40 devstack cinder-volume[85185]: INFO dbcounter [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Registered counter for database cinder Jul 01 03:56:40 devstack cinder-volume[85185]: DEBUG oslo_db.sqlalchemy.engines [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85185) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG dbcounter [-] [85185] Writer thread running {{(pid=85185) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 01 03:56:41 devstack cinder-volume[85185]: INFO cinder.rpc [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 01 03:56:41 devstack cinder-volume[85185]: INFO cinder.rpc [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_db.sqlalchemy.engines [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85185) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 03:56:41 devstack cinder-volume[85185]: INFO cinder.volume.manager [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Determined volume DB was empty at startup. Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG cinder.volume.manager [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85185) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 01 03:56:41 devstack cinder-volume[85185]: INFO cinder.volume.manager [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 01 03:56:41 devstack cinder-volume[85185]: WARNING stevedore.named [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 01 03:56:41 devstack cinder-volume[85185]: WARNING castellan.key_manager [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 01 03:56:41 devstack cinder-volume[85185]: WARNING cinder.keymgr.conf_key_mgr [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 01 03:56:41 devstack cinder-volume[74717]: DEBUG oslo_concurrency.lockutils [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Acquiring lock "singleton_lock" {{(pid=74717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 01 03:56:41 devstack cinder-volume[74717]: DEBUG oslo_concurrency.lockutils [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Acquired lock "singleton_lock" {{(pid=74717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 01 03:56:41 devstack cinder-volume[74717]: DEBUG oslo_concurrency.lockutils [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Releasing lock "singleton_lock" {{(pid=74717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 01 03:56:41 devstack cinder-volume[74717]: WARNING amqp [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 01 03:56:41 devstack cinder-volume[74717]: WARNING amqp [None req-d1393f3d-6b26-4288-8c9f-884656aaa374 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 01 03:56:41 devstack cinder-volume[85185]: INFO cinder.volume.manager [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_db.sqlalchemy.engines [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85185) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 03:56:41 devstack cinder-volume[85185]: INFO oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Starting 1 workers Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Started child 85450 {{(pid=85185) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Full set of CONF: {{(pid=85185) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] ******************************************************************************** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Configuration options gathered from: {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 01 03:56:41 devstack cinder-volume[85450]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] ================================================================================ {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] allow_availability_zone_fallback = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] allow_compression_on_image_upload = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] allowed_direct_url_schemes = [] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] api_rate_limit = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] auth_strategy = keystone {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_availability_zone = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_host = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_name = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_stats_polling_interval = 60 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backup_api_class = cinder.backup.api.API {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backup_name_template = backup-%s {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backup_use_same_host = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backup_use_temp_snapshot = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] chap_password = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] chap_username = {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cinder_internal_tenant_project_id = e437ca00bb2f42a3ab87c2d64d852553 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cinder_internal_tenant_user_id = fdd579b2b0ac4376bf2f124c4a100e70 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cluster = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] compression_format = gzip {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] compute_api_class = cinder.compute.nova.API {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] config_dir = [] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] config_source = [] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] control_exchange = openstack {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] debug = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] default_availability_zone = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] default_group_type = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] default_volume_type = QuobyteHD {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] disk_geometry = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] driver_client_cert = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] driver_client_cert_key = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] driver_data_namespace = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] driver_ssl_cert_path = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] driver_ssl_cert_verify = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] driver_use_ssl = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] enable_new_services = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] enable_unsupported_driver = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] enabled_backends = ['QuobyteHD'] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] enforce_multipath_for_image_xfer = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] filter_function = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance_api_insecure = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance_api_servers = ['http://192.168.122.240/image'] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance_api_ssl_compression = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance_ca_certificates_file = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance_catalog_info = image:glance:publicURL {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance_certfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance_keyfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance_num_retries = 3 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance_request_timeout = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] goodness_function = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] graceful_shutdown_timeout = 5 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] group_api_class = cinder.group.api.API {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] host = devstack {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] image_compress_on_upload = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] image_conversion_address_space_limit = 1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] image_conversion_cpu_limit = 60 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] image_conversion_disable = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] image_upload_use_cinder_backend = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] image_upload_use_internal_tenant = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] image_volume_cache_enabled = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] image_volume_cache_max_count = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] image_volume_cache_max_size_gb = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85450]: INFO cinder.volume.manager [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Starting volume driver QuobyteDriver (1.1.14) Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] init_host_max_objects_retrieval = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85450]: DEBUG cinder.volume.drivers.remotefs [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85450) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] instance_format = [instance: %(uuid)s] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] iscsi_target_flags = {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] iscsi_write_cache = on {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] iser_helper = tgtadm {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] iser_ip_address = 192.168.122.240 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] iser_port = 3260 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] log_color = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] log_config_append = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] log_dir = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] log_file = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] log_options = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] log_rotate_interval = 1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] log_rotate_interval_type = days {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] log_rotation_type = none {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] max_age = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] max_logfile_count = 30 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] max_logfile_size_mb = 200 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] max_over_subscription_ratio = 20.0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] message_reap_interval = 86400 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] message_ttl = 2592000 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] migration_create_volume_timeout_secs = 300 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] monkey_patch = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] monkey_patch_modules = [] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] my_ip = 192.168.122.240 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] no_snapshot_gb_quota = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] num_iser_scan_tries = 3 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] num_shell_tries = 3 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] num_volume_device_scan_tries = 3 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] nvmeof_conn_info_version = 1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] nvmet_ns_id = 10 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] nvmet_port_id = 1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] osapi_max_limit = 1000 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] osapi_volume_ext_list = [] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] osapi_volume_listen = 0.0.0.0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] osapi_volume_listen_port = 8776 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] osapi_volume_use_ssl = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] osapi_volume_workers = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] per_volume_size_limit = -1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] periodic_fuzzy_delay = 60 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] periodic_interval = 60 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] project_id_regex = [0-9a-f\-]+ {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] public_endpoint = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] publish_errors = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] quota_backup_gigabytes = 1000 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] quota_backups = 10 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] quota_gigabytes = 1000 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] quota_groups = 10 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] quota_snapshots = 10 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] quota_volumes = 10 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] rate_limit_burst = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] rate_limit_except_level = CRITICAL {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] rate_limit_interval = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] reinit_driver_count = 3 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] replication_device = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] report_discard_supported = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] report_interval = 120 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] reservation_clean_interval = 86400 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] reservation_expire = 86400 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] reserved_image_namespaces = [] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] reserved_percentage = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] rpc_response_timeout = 120 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] run_external_periodic_tasks = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] scst_target_driver = iscsi {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] scst_target_iqn_name = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] service_down_time = 720 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] shell_completion = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] snapshot_name_template = snapshot-%s {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] split_loggers = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] state_path = /opt/stack/data/cinder {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] storage_availability_zone = nova {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] storage_protocol = iSCSI {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] syslog_log_facility = LOG_USER {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] target_helper = lioadm {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] target_ip_address = 192.168.122.240 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] target_port = 3260 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] target_protocol = iscsi {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] target_secondary_ip_addresses = [] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] trace_flags = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] transfer_api_class = cinder.transfer.api.API {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] transport_url = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] until_refresh = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] use_chap_auth = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] use_default_quota_class = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] use_journal = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] use_json = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] use_multipath_for_image_xfer = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] use_stderr = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] use_syslog = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] verify_glance_signatures = enabled {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] volume_api_class = cinder.volume.api.API {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] volume_backend_name = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] volume_clear = zero {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] volume_clear_ionice = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] volume_clear_size = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] volume_copy_bps_limit = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] volume_dd_blocksize = 1M {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] volume_name_template = volume-%s {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] volume_service_inithost_offload = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] volume_usage_audit_period = month {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] zoning_mode = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_concurrency.disable_process_locking = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85450]: DEBUG cinder.volume.drivers.quobyte [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85450) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 01 03:56:41 devstack cinder-volume[85450]: WARNING cinder.volume.drivers.quobyte [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 01 03:56:41 devstack cinder-volume[85450]: WARNING cinder.volume.drivers.quobyte [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85450]: DEBUG oslo_concurrency.processutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Running cmd (subprocess): mount.quobyte {{(pid=85450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.auth_section = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.auth_type = password {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.auth_version = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.cache = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.certfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.delay_auth_decision = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.http_connect_timeout = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.include_service_catalog = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.insecure = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.interface = public {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.keyfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_password = {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcache_username = {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.region_name = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.service_token_roles_required = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.service_type = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.token_cache_time = 300 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.240/identity {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.backend = dogpile.cache.null {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.backend_argument = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.backend_expiration_time = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.config_prefix = cache.oslo {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.debug_cache_backend = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.enable_retry_client = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.enable_socket_keepalive = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.enabled = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.expiration_time = 600 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.hashclient_retry_attempts = 2 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.memcache_dead_retry = 300 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.memcache_pool_maxsize = 10 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.memcache_sasl_enabled = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.password = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.proxies = [] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.redis_db = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.redis_sentinel_service_name = mymaster {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.redis_server = localhost:6379 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.retry_attempts = 2 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.retry_delay = 0.0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.socket_keepalive_count = 1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.socket_keepalive_idle = 1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.socket_keepalive_interval = 1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.socket_timeout = 1.0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.tls_allowed_ciphers = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.tls_cafile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.tls_certfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.tls_enabled = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.tls_keyfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cache.username = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] coordination.backend_url = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.asyncio_connection = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.asyncio_slave_connection = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.backend = sqlalchemy {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.connection = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.connection_debug = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.connection_parameters = {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.connection_recycle_time = 3600 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.connection_trace = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.db_inc_retry_interval = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.db_max_retries = 20 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.db_max_retry_interval = 10 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.db_retry_interval = 1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.max_overflow = 50 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.max_pool_size = 5 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.max_retries = 10 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.mysql_wsrep_sync_wait = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.pool_timeout = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.retry_interval = 10 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.slave_connection = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.sqlite_synchronous = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.synchronous_reader = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] database.use_db_reconnect = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] profiler.connection_string = messaging:// {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] profiler.enabled = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] profiler.es_doc_type = notification {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] profiler.es_scroll_size = 10000 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] profiler.es_scroll_time = 2m {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] profiler.filter_error_trace = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] profiler.hmac_keys = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] profiler.sentinel_service_name = mymaster {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] profiler.socket_timeout = 0.1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] profiler.trace_requests = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] profiler.trace_sqlalchemy = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] profiler_jaeger.process_tags = {} {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] profiler_jaeger.service_name_prefix = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] profiler_otlp.service_name_prefix = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_policy.enforce_new_defaults = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_policy.enforce_scope = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_policy.policy_default_rule = default {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_policy.policy_file = policy.yaml {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_policy.remote_timeout = 60.0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] privsep_osbrick.group = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] privsep_osbrick.helper_command = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] privsep_osbrick.user = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cinder_sys_admin.group = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cinder_sys_admin.helper_command = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] cinder_sys_admin.user = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] service_user.auth_section = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] service_user.auth_type = password {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] service_user.cafile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] service_user.certfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] service_user.collect_timing = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] service_user.insecure = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] service_user.keyfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] service_user.send_service_user_token = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] service_user.split_loggers = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] service_user.timeout = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance.auth_section = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance.auth_type = password {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance.certfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance.collect_timing = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance.insecure = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance.keyfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance.region_name = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance.split_loggers = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] glance.timeout = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.backend_availability_zone = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.chap_password = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.chap_username = {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.disk_geometry = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.driver_client_cert = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.driver_client_cert_key = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.driver_data_namespace = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.driver_use_ssl = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.enable_unsupported_driver = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.extra_capabilities = {} {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.filter_function = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.goodness_function = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.iscsi_target_flags = {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.iscsi_write_cache = on {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.iser_helper = tgtadm {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.iser_ip_address = 192.168.122.240 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.iser_port = 3260 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack quobyte-client[85464]: Reading configuration file: /etc/quobyte/client.cfg Jul 01 03:56:41 devstack quobyte-client[85464]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.nas_host = {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85450]: DEBUG oslo_concurrency.processutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] CMD "mount.quobyte" returned: 1 in 0.114s {{(pid=85450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.nas_login = admin {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.nas_mount_options = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85450]: DEBUG oslo_concurrency.lockutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:56:41 devstack cinder-volume[85450]: DEBUG oslo_concurrency.lockutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.nas_password = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85450]: DEBUG cinder.volume.drivers.quobyte [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=85450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.nas_private_key = {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85450]: INFO cinder.volume.drivers.quobyte [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 ... Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.nas_share_path = {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.nas_ssh_port = 22 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.num_shell_tries = 3 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85450]: DEBUG oslo_concurrency.processutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc -c /etc/quobyte/client-cinder.cfg {{(pid=85450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.nvmet_port_id = 1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.quobyte_client_cfg = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.quobyte_volume_url = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.replication_device = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.report_discard_supported = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.reserved_percentage = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.scst_target_driver = iscsi {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.scst_target_iqn_name = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.storage_protocol = iSCSI {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.target_helper = tgtadm {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.target_ip_address = 192.168.122.240 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.target_port = 3260 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.target_protocol = iscsi {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.trace_flags = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.unique_fqdn_network = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.use_chap_auth = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.volume_backend_name = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.volume_clear = zero {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.volume_clear_ionice = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.volume_clear_size = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_reports.file_event_handler = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_reports.log_dir = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.backend_availability_zone = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.backend_host = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.chap_password = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.chap_username = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.chiscsi_conf = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.disk_geometry = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.driver_client_cert = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.driver_client_cert_key = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.driver_data_namespace = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.driver_use_ssl = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.extra_capabilities = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.filter_function = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.goodness_function = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.iscsi_target_flags = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.iscsi_write_cache = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.iser_helper = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.iser_ip_address = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.iser_port = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.iser_target_prefix = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.nas_host = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.nas_login = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.nas_mount_options = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.nas_password = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.nas_private_key = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.nas_share_path = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.nas_ssh_port = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.num_shell_tries = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.nvmet_ns_id = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.nvmet_port_id = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack sudo[85465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc -c /etc/quobyte/client-cinder.cfg Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.replication_device = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.report_discard_supported = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.reserved_percentage = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.scst_target_driver = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.storage_protocol = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.target_helper = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.target_ip_address = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.target_port = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.target_prefix = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.target_protocol = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.trace_flags = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.unique_fqdn_network = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.use_chap_auth = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.volume_clear = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.volume_clear_ionice = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.volume_clear_size = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] QuobyteHD.volumes_dir = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.ssl = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.ssl_version = {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_notifications.driver = [] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_notifications.retry = -1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] oslo_messaging_notifications.transport_url = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] key_manager.fixed_key = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.barbican_api_version = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.barbican_endpoint = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.barbican_endpoint_type = public {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.barbican_region_name = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.cafile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.certfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.collect_timing = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.insecure = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.keyfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.number_of_retries = 60 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.retry_delay = 1 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.send_service_user_token = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.split_loggers = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.timeout = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.verify_ssl = True {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican.verify_ssl_path = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican_service_user.auth_section = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican_service_user.auth_type = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican_service_user.cafile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican_service_user.certfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican_service_user.collect_timing = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican_service_user.insecure = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican_service_user.keyfile = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican_service_user.split_loggers = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] barbican_service_user.timeout = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] vault.approle_role_id = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] vault.approle_secret_id = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] vault.kv_mountpoint = secret {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] vault.kv_path = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] vault.kv_version = 2 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] vault.namespace = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] vault.root_token_id = **** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] vault.ssl_ca_crt_file = None {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] vault.timeout = 60.0 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] vault.use_ssl = False {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:41 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] ******************************************************************************** {{(pid=85185) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 01 03:56:42 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root Jul 01 03:56:42 devstack cinder-volume[85450]: DEBUG oslo_concurrency.processutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.783s {{(pid=85450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:56:42 devstack cinder-volume[85450]: INFO cinder.volume.drivers.quobyte [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 succeeded Jul 01 03:56:42 devstack cinder-volume[85450]: DEBUG cinder.volume.drivers.quobyte [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=85450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:56:42 devstack cinder-volume[85450]: DEBUG oslo_concurrency.lockutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.802s {{(pid=85450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:56:42 devstack cinder-volume[85450]: DEBUG oslo_concurrency.processutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=85450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:56:42 devstack sudo[85549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 03:56:42 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:56:43 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root Jul 01 03:56:43 devstack cinder-volume[85450]: DEBUG oslo_concurrency.processutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.645s {{(pid=85450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:56:43 devstack cinder-volume[85450]: INFO cinder.volume.driver [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Driver hasn't implemented _init_vendor_properties() Jul 01 03:56:43 devstack cinder-volume[85450]: DEBUG cinder.volume.driver [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7443084716797, 'free_capacity_gb': 1775.7443084716797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85450) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 01 03:56:43 devstack cinder-volume[85450]: DEBUG oslo_db.sqlalchemy.engines [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85450) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 03:56:43 devstack cinder-volume[85450]: DEBUG dbcounter [-] [85450] Writer thread running {{(pid=85450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 01 03:56:43 devstack cinder-volume[85450]: DEBUG cinder.db.api [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Building query based on filter {{(pid=85450) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 01 03:56:43 devstack cinder-volume[85450]: DEBUG cinder.image.image_utils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85450) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 01 03:56:43 devstack cinder-volume[85450]: INFO cinder.keymgr.migration [None req-07a9c128-9068-4742-ac57-6e7d9fb51bd0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 01 03:56:43 devstack cinder-volume[85450]: DEBUG oslo_concurrency.lockutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:56:43 devstack cinder-volume[85450]: DEBUG oslo_concurrency.lockutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:56:43 devstack cinder-volume[85450]: DEBUG cinder.volume.drivers.quobyte [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=85450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:56:43 devstack cinder-volume[85450]: DEBUG cinder.volume.drivers.quobyte [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=85450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:56:43 devstack cinder-volume[85450]: DEBUG oslo_concurrency.lockutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:56:43 devstack cinder-volume[85450]: DEBUG oslo_concurrency.processutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=85450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:56:43 devstack sudo[85568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 03:56:43 devstack sudo[85568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:56:44 devstack sudo[85568]: pam_unix(sudo:session): session closed for user root Jul 01 03:56:44 devstack cinder-volume[85450]: DEBUG oslo_concurrency.processutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.630s {{(pid=85450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:56:44 devstack cinder-volume[85450]: DEBUG cinder.manager [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Notifying Schedulers of capabilities ... {{(pid=85450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 03:56:44 devstack cinder-volume[85450]: INFO cinder.volume.manager [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Driver initialization completed successfully. Jul 01 03:56:44 devstack cinder-volume[85450]: INFO cinder.manager [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Initiating service 3 cleanup Jul 01 03:56:44 devstack cinder-volume[85450]: INFO cinder.manager [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Service 3 cleanup completed. Jul 01 03:56:44 devstack cinder-volume[85450]: DEBUG cinder.service [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Creating RPC server for service cinder-volume {{(pid=85450) start /opt/stack/cinder/cinder/service.py:231}} Jul 01 03:56:44 devstack cinder-volume[85450]: DEBUG cinder.service [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85450) start /opt/stack/cinder/cinder/service.py:237}} Jul 01 03:56:44 devstack cinder-volume[85450]: INFO cinder.volume.manager [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 01 03:56:44 devstack cinder-volume[85450]: DEBUG oslo_concurrency.lockutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:56:44 devstack cinder-volume[85450]: DEBUG oslo_concurrency.lockutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:56:44 devstack cinder-volume[85450]: DEBUG cinder.volume.drivers.quobyte [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=85450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:56:44 devstack cinder-volume[85450]: DEBUG cinder.volume.drivers.quobyte [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=85450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:56:44 devstack cinder-volume[85450]: DEBUG oslo_concurrency.lockutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:56:44 devstack cinder-volume[85450]: DEBUG oslo_concurrency.processutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=85450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:56:44 devstack sudo[85591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 03:56:44 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:56:45 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root Jul 01 03:56:45 devstack cinder-volume[85450]: DEBUG oslo_concurrency.processutils [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.906s {{(pid=85450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:56:45 devstack cinder-volume[85450]: INFO cinder.volume.manager [None req-5d8cfd6b-e1a3-4d7d-b128-ace70794e7fc None None] Driver post RPC initialization completed successfully. Jul 01 03:56:49 devstack cinder-volume[85450]: DEBUG oslo_concurrency.lockutils [None req-faded43e-206f-42ee-b978-810e175f30af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:56:49 devstack cinder-volume[85450]: DEBUG oslo_concurrency.lockutils [None req-faded43e-206f-42ee-b978-810e175f30af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:56:49 devstack cinder-volume[85450]: DEBUG cinder.volume.drivers.quobyte [None req-faded43e-206f-42ee-b978-810e175f30af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=85450) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:56:49 devstack cinder-volume[85450]: DEBUG cinder.volume.drivers.quobyte [None req-faded43e-206f-42ee-b978-810e175f30af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=85450) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:56:49 devstack cinder-volume[85450]: DEBUG oslo_concurrency.lockutils [None req-faded43e-206f-42ee-b978-810e175f30af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85450) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:56:49 devstack cinder-volume[85450]: DEBUG oslo_concurrency.processutils [None req-faded43e-206f-42ee-b978-810e175f30af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=85450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:56:49 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 03:56:49 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:56:50 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Jul 01 03:56:50 devstack cinder-volume[85450]: DEBUG oslo_concurrency.processutils [None req-faded43e-206f-42ee-b978-810e175f30af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.633s {{(pid=85450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:56:50 devstack cinder-volume[85450]: DEBUG cinder.manager [None req-faded43e-206f-42ee-b978-810e175f30af None None] Notifying Schedulers of capabilities ... {{(pid=85450) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 03:56:50 devstack cinder-volume[85450]: DEBUG oslo_service.periodic_task [None req-0594cc3c-d0fd-4780-8618-9f2300049556 None None] Running periodic task VolumeManager._thread_info {{(pid=85450) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 03:56:50 devstack cinder-volume[85450]: DEBUG cinder.volume.manager [None req-0594cc3c-d0fd-4780-8618-9f2300049556 None None] thread count: 6 {{(pid=85450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 03:56:50 devstack cinder-volume[85450]: DEBUG cinder.volume.manager [None req-0594cc3c-d0fd-4780-8618-9f2300049556 None None] thread info: [<_MainThread(MainThread, started 138950206632064)>, , , , , ] {{(pid=85450) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 03:56:50 devstack cinder-volume[85185]: INFO oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Caught SIGTERM, stopping children Jul 01 03:56:50 devstack cinder-volume[85185]: DEBUG oslo_concurrency.lockutils [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Acquiring lock "singleton_lock" {{(pid=85185) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 01 03:56:50 devstack cinder-volume[85185]: DEBUG oslo_concurrency.lockutils [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Acquired lock "singleton_lock" {{(pid=85185) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 01 03:56:50 devstack cinder-volume[85185]: DEBUG oslo_concurrency.lockutils [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Releasing lock "singleton_lock" {{(pid=85185) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 01 03:56:50 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Stop services. {{(pid=85185) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 01 03:56:50 devstack cinder-volume[85185]: DEBUG oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Killing children. {{(pid=85185) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 01 03:56:50 devstack cinder-volume[85185]: INFO oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Waiting on 1 children to exit Jul 01 03:56:52 devstack cinder-volume[85450]: DEBUG oslo_concurrency.lockutils [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Acquiring lock "singleton_lock" {{(pid=85450) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 01 03:56:52 devstack cinder-volume[85450]: DEBUG oslo_concurrency.lockutils [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Acquired lock "singleton_lock" {{(pid=85450) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 01 03:56:52 devstack cinder-volume[85450]: DEBUG oslo_concurrency.lockutils [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Releasing lock "singleton_lock" {{(pid=85450) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 01 03:56:52 devstack cinder-volume[85450]: WARNING amqp [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 01 03:56:52 devstack cinder-volume[85450]: WARNING amqp [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 01 03:56:52 devstack cinder-volume[85185]: INFO oslo_service.backend._eventlet.service [None req-861be3e9-1fe9-4440-9ed4-4d147d22fa2c None None] Child 85450 exited with status 0 Jul 01 03:56:53 devstack cinder-volume[85924]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 01 03:56:53 devstack cinder-volume[85924]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 01 03:56:53 devstack cinder-volume[85924]: we strongly recommend against using it for new projects. Jul 01 03:56:53 devstack cinder-volume[85924]: If you are already using Eventlet, we recommend migrating to a different Jul 01 03:56:53 devstack cinder-volume[85924]: framework. For more detail see Jul 01 03:56:53 devstack cinder-volume[85924]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 01 03:56:53 devstack cinder-volume[85924]: import eventlet # noqa Jul 01 03:56:56 devstack cinder-volume[85924]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 01 03:56:56 devstack cinder-volume[85924]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 01 03:56:56 devstack cinder-volume[85924]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 01 03:56:56 devstack cinder-volume[85924]: INFO dbcounter [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] Registered counter for database cinder Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_db.sqlalchemy.engines [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG dbcounter [-] [85924] Writer thread running {{(pid=85924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 01 03:56:57 devstack cinder-volume[85924]: INFO cinder.rpc [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 01 03:56:57 devstack cinder-volume[85924]: INFO cinder.rpc [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_db.sqlalchemy.engines [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 03:56:57 devstack cinder-volume[85924]: INFO cinder.volume.manager [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] Determined volume DB was empty at startup. Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG cinder.volume.manager [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85924) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 01 03:56:57 devstack cinder-volume[85924]: WARNING stevedore.named [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 01 03:56:57 devstack cinder-volume[85924]: WARNING castellan.key_manager [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 01 03:56:57 devstack cinder-volume[85924]: WARNING cinder.keymgr.conf_key_mgr [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 01 03:56:57 devstack cinder-volume[85924]: INFO cinder.volume.manager [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_db.sqlalchemy.engines [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 03:56:57 devstack cinder-volume[85924]: INFO oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] Starting 1 workers Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] Started child 86177 {{(pid=85924) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] Full set of CONF: {{(pid=85924) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] ******************************************************************************** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] Configuration options gathered from: {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] ================================================================================ {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] allow_availability_zone_fallback = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] allow_compression_on_image_upload = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] allowed_direct_url_schemes = [] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] api_rate_limit = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:57 devstack cinder-volume[86177]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] auth_strategy = keystone {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_availability_zone = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_host = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_name = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_stats_polling_interval = 60 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:57 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backup_api_class = cinder.backup.api.API {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backup_name_template = backup-%s {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backup_use_same_host = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backup_use_temp_snapshot = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] chap_password = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] chap_username = {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cinder_internal_tenant_project_id = e437ca00bb2f42a3ab87c2d64d852553 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cinder_internal_tenant_user_id = fdd579b2b0ac4376bf2f124c4a100e70 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cluster = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] compression_format = gzip {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] compute_api_class = cinder.compute.nova.API {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] config_dir = [] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] config_source = [] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] control_exchange = openstack {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] debug = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] default_availability_zone = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] default_group_type = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] default_volume_type = QuobyteHD {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] disk_geometry = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] driver_client_cert = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] driver_client_cert_key = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] driver_data_namespace = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] driver_ssl_cert_path = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] driver_ssl_cert_verify = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] driver_use_ssl = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] enable_new_services = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] enable_unsupported_driver = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] enabled_backends = ['QuobyteHD'] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] enforce_multipath_for_image_xfer = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] filter_function = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance_api_insecure = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance_api_servers = ['http://192.168.122.240/image'] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance_api_ssl_compression = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance_ca_certificates_file = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance_catalog_info = image:glance:publicURL {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance_certfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance_keyfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance_num_retries = 3 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance_request_timeout = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] goodness_function = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] graceful_shutdown_timeout = 5 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] group_api_class = cinder.group.api.API {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] host = devstack {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] image_compress_on_upload = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] image_conversion_address_space_limit = 1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] image_conversion_cpu_limit = 60 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] image_conversion_disable = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] image_upload_use_cinder_backend = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] image_upload_use_internal_tenant = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] image_volume_cache_enabled = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] image_volume_cache_max_count = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] image_volume_cache_max_size_gb = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] init_host_max_objects_retrieval = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] instance_format = [instance: %(uuid)s] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] iscsi_target_flags = {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] iscsi_write_cache = on {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] iser_helper = tgtadm {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] iser_ip_address = 192.168.122.240 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] iser_port = 3260 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] log_color = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] log_config_append = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] log_dir = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] log_file = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] log_options = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] log_rotate_interval = 1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] log_rotate_interval_type = days {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] log_rotation_type = none {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] max_age = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] max_logfile_count = 30 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] max_logfile_size_mb = 200 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] max_over_subscription_ratio = 20.0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] message_reap_interval = 86400 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] message_ttl = 2592000 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] migration_create_volume_timeout_secs = 300 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] monkey_patch = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] monkey_patch_modules = [] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] my_ip = 192.168.122.240 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] no_snapshot_gb_quota = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] num_iser_scan_tries = 3 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] num_shell_tries = 3 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 01 03:56:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86177) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] num_volume_device_scan_tries = 3 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] nvmeof_conn_info_version = 1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] nvmet_ns_id = 10 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] nvmet_port_id = 1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] osapi_max_limit = 1000 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] osapi_volume_ext_list = [] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] osapi_volume_listen = 0.0.0.0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] osapi_volume_listen_port = 8776 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] osapi_volume_use_ssl = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] osapi_volume_workers = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] per_volume_size_limit = -1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] periodic_fuzzy_delay = 60 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] periodic_interval = 60 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] project_id_regex = [0-9a-f\-]+ {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] public_endpoint = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] publish_errors = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] quota_backup_gigabytes = 1000 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] quota_backups = 10 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] quota_gigabytes = 1000 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] quota_groups = 10 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] quota_snapshots = 10 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] quota_volumes = 10 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] rate_limit_burst = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] rate_limit_except_level = CRITICAL {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] rate_limit_interval = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] reinit_driver_count = 3 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] replication_device = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] report_discard_supported = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] report_interval = 120 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] reservation_clean_interval = 86400 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] reservation_expire = 86400 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] reserved_image_namespaces = [] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] reserved_percentage = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] rpc_response_timeout = 120 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] run_external_periodic_tasks = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] scst_target_driver = iscsi {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] scst_target_iqn_name = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] service_down_time = 720 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] shell_completion = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] snapshot_name_template = snapshot-%s {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] split_loggers = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] state_path = /opt/stack/data/cinder {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] storage_availability_zone = nova {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] storage_protocol = iSCSI {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] syslog_log_facility = LOG_USER {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] target_helper = lioadm {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] target_ip_address = 192.168.122.240 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] target_port = 3260 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] target_protocol = iscsi {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] target_secondary_ip_addresses = [] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] trace_flags = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] transfer_api_class = cinder.transfer.api.API {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] transport_url = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] until_refresh = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] use_chap_auth = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] use_default_quota_class = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] use_journal = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] use_json = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] use_multipath_for_image_xfer = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] use_stderr = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] use_syslog = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] verify_glance_signatures = enabled {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] volume_api_class = cinder.volume.api.API {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] volume_backend_name = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] volume_clear = zero {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] volume_clear_ionice = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] volume_clear_size = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] volume_copy_bps_limit = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] volume_dd_blocksize = 1M {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] volume_name_template = volume-%s {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] volume_service_inithost_offload = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] volume_usage_audit_period = month {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] zoning_mode = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_concurrency.disable_process_locking = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.auth_section = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.auth_type = password {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.auth_version = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.cache = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.certfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.delay_auth_decision = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.http_connect_timeout = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.include_service_catalog = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.insecure = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.interface = public {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.keyfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_password = {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcache_username = {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.region_name = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.service_token_roles_required = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.service_type = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.token_cache_time = 300 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.240/identity {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.backend = dogpile.cache.null {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.backend_argument = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.backend_expiration_time = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.config_prefix = cache.oslo {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.debug_cache_backend = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.enable_retry_client = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.enable_socket_keepalive = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.enabled = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.expiration_time = 600 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.hashclient_retry_attempts = 2 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.memcache_dead_retry = 300 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.memcache_pool_maxsize = 10 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.memcache_sasl_enabled = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.password = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.proxies = [] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.redis_db = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.redis_sentinel_service_name = mymaster {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.redis_server = localhost:6379 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.retry_attempts = 2 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.retry_delay = 0.0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.socket_keepalive_count = 1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.socket_keepalive_idle = 1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.socket_keepalive_interval = 1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.socket_timeout = 1.0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.tls_allowed_ciphers = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.tls_cafile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.tls_certfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.tls_enabled = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.tls_keyfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86177) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 01 03:56:58 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.quobyte [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 01 03:56:58 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.quobyte [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cache.username = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] coordination.backend_url = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.asyncio_connection = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.asyncio_slave_connection = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.backend = sqlalchemy {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.connection = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Running cmd (subprocess): mount.quobyte {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.connection_debug = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.connection_parameters = {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.connection_recycle_time = 3600 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.connection_trace = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.db_inc_retry_interval = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.db_max_retries = 20 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.db_max_retry_interval = 10 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.db_retry_interval = 1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.max_overflow = 50 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.max_pool_size = 5 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.max_retries = 10 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.mysql_wsrep_sync_wait = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.pool_timeout = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.retry_interval = 10 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.slave_connection = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.sqlite_synchronous = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.synchronous_reader = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] database.use_db_reconnect = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] profiler.connection_string = messaging:// {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] profiler.enabled = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] profiler.es_doc_type = notification {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] profiler.es_scroll_size = 10000 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] profiler.es_scroll_time = 2m {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] profiler.filter_error_trace = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] profiler.hmac_keys = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] profiler.sentinel_service_name = mymaster {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] profiler.socket_timeout = 0.1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] profiler.trace_requests = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] profiler.trace_sqlalchemy = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] profiler_jaeger.process_tags = {} {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] profiler_jaeger.service_name_prefix = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] profiler_otlp.service_name_prefix = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_policy.enforce_new_defaults = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_policy.enforce_scope = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_policy.policy_default_rule = default {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_policy.policy_file = policy.yaml {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_policy.remote_timeout = 60.0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] privsep_osbrick.group = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] privsep_osbrick.helper_command = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] privsep_osbrick.user = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cinder_sys_admin.group = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cinder_sys_admin.helper_command = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] cinder_sys_admin.user = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] service_user.auth_section = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] service_user.auth_type = password {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] service_user.cafile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] service_user.certfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] service_user.collect_timing = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] service_user.insecure = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] service_user.keyfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] service_user.send_service_user_token = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] service_user.split_loggers = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] service_user.timeout = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance.auth_section = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance.auth_type = password {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance.certfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance.collect_timing = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance.insecure = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance.keyfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance.region_name = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance.split_loggers = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] glance.timeout = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.backend_availability_zone = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.chap_password = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.chap_username = {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.disk_geometry = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.driver_client_cert = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.driver_client_cert_key = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.driver_data_namespace = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.driver_use_ssl = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.enable_unsupported_driver = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.extra_capabilities = {} {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.filter_function = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.goodness_function = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.iscsi_target_flags = {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.iscsi_write_cache = on {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.iser_helper = tgtadm {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.iser_ip_address = 192.168.122.240 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.iser_port = 3260 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.nas_host = {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.nas_login = admin {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.nas_mount_options = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.nas_password = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.nas_private_key = {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.nas_share_path = {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.nas_ssh_port = 22 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.num_shell_tries = 3 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.nvmet_port_id = 1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.quobyte_client_cfg = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.quobyte_volume_url = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack quobyte-client[86178]: Reading configuration file: /etc/quobyte/client.cfg Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.replication_device = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.report_discard_supported = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.reserved_percentage = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.scst_target_driver = iscsi {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.scst_target_iqn_name = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack quobyte-client[86178]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.storage_protocol = iSCSI {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] CMD "mount.quobyte" returned: 1 in 0.133s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:56:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.target_helper = tgtadm {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.target_ip_address = 192.168.122.240 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.target_port = 3260 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.target_protocol = iscsi {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.trace_flags = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.unique_fqdn_network = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.use_chap_auth = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.volume_backend_name = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.volume_clear = zero {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.volume_clear_ionice = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.volume_clear_size = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_reports.file_event_handler = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_reports.log_dir = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.backend_availability_zone = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.backend_host = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.chap_password = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.chap_username = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.chiscsi_conf = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.disk_geometry = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.driver_client_cert = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.driver_client_cert_key = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.driver_data_namespace = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.driver_use_ssl = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.extra_capabilities = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.filter_function = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.goodness_function = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.iscsi_target_flags = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.iscsi_write_cache = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.iser_helper = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.iser_ip_address = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.iser_port = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.iser_target_prefix = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.nas_host = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.nas_login = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.nas_mount_options = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.nas_password = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.nas_private_key = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.nas_share_path = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.nas_ssh_port = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.num_shell_tries = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.nvmet_ns_id = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.nvmet_port_id = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack sudo[86180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.replication_device = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.report_discard_supported = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.reserved_percentage = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.scst_target_driver = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.storage_protocol = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.target_helper = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.target_ip_address = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.target_port = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.target_prefix = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.target_protocol = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.trace_flags = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.unique_fqdn_network = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.use_chap_auth = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.volume_clear = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.volume_clear_ionice = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.volume_clear_size = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] QuobyteHD.volumes_dir = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.ssl = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.ssl_version = {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_notifications.driver = [] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_notifications.retry = -1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] oslo_messaging_notifications.transport_url = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] key_manager.fixed_key = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.barbican_api_version = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.barbican_endpoint = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.barbican_endpoint_type = public {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.barbican_region_name = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.cafile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.certfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.collect_timing = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.insecure = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.keyfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.number_of_retries = 60 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.retry_delay = 1 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.send_service_user_token = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.split_loggers = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.timeout = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.verify_ssl = True {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican.verify_ssl_path = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican_service_user.auth_section = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican_service_user.auth_type = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican_service_user.cafile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican_service_user.certfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican_service_user.collect_timing = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican_service_user.insecure = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican_service_user.keyfile = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican_service_user.split_loggers = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] barbican_service_user.timeout = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] vault.approle_role_id = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] vault.approle_secret_id = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] vault.kv_mountpoint = secret {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] vault.kv_path = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] vault.kv_version = 2 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] vault.namespace = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] vault.root_token_id = **** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] vault.ssl_ca_crt_file = None {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] vault.timeout = 60.0 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] vault.use_ssl = False {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 01 03:56:58 devstack cinder-volume[85924]: DEBUG oslo_service.backend._eventlet.service [None req-38c6a0ed-8fed-4cae-94a6-30d399d5799f None None] ******************************************************************************** {{(pid=85924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 01 03:56:58 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root Jul 01 03:56:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.665s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:56:58 devstack cinder-volume[86177]: INFO cinder.volume.driver [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Driver hasn't implemented _init_vendor_properties() Jul 01 03:56:58 devstack cinder-volume[86177]: DEBUG cinder.volume.driver [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7443084716797, 'free_capacity_gb': 1775.7443084716797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86177) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG oslo_db.sqlalchemy.engines [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86177) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writer thread running {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG cinder.db.api [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Building query based on filter {{(pid=86177) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86177) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:56:59 devstack cinder-volume[86177]: INFO cinder.keymgr.migration [None req-d930b2a4-5aa7-4a4f-b9f3-5dc3109771d2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 01 03:56:59 devstack sudo[86186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 03:56:59 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:56:59 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.628s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 03:56:59 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Driver initialization completed successfully. Jul 01 03:56:59 devstack cinder-volume[86177]: INFO cinder.manager [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Initiating service 3 cleanup Jul 01 03:56:59 devstack cinder-volume[86177]: INFO cinder.manager [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Service 3 cleanup completed. Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG cinder.service [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Creating RPC server for service cinder-volume {{(pid=86177) start /opt/stack/cinder/cinder/service.py:231}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG cinder.service [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86177) start /opt/stack/cinder/cinder/service.py:237}} Jul 01 03:56:59 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:56:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:56:59 devstack sudo[86190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 03:56:59 devstack sudo[86190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:57:00 devstack sudo[86190]: pam_unix(sudo:session): session closed for user root Jul 01 03:57:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.614s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:57:00 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-84e17717-a689-4e82-a5dc-171bd8992c88 None None] Driver post RPC initialization completed successfully. Jul 01 03:57:07 devstack cinder-volume[85924]: DEBUG dbcounter [-] [85924] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 03:57:09 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 03:57:10 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=3 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 03:57:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 03:57:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 6 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 03:57:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Flow 'volume_create_manager' (b9ac29ed-48f8-41e5-b54f-64f6a61f1fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2e9bd5-5781-4ca5-ad8a-25c5e5675e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2e9bd5-5781-4ca5-ad8a-25c5e5675e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T01:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-24460464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f737696-68a6-4568-affa-049f3de2528e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc9eb3ed29849a6a650985a014bdf83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T01:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T01:58:19Z,use_quota=True,user_id='beedee6ef6a44a1a8189ca06793654ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9c4c76-286a-49e1-bf88-d00c5e977cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9c4c76-286a-49e1-bf88-d00c5e977cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30092943-c70a-44c7-acba-b8dcaeedb6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30092943-c70a-44c7-acba-b8dcaeedb6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f737696-68a6-4568-affa-049f3de2528e', 'volume_name': 'volume-3f737696-68a6-4568-affa-049f3de2528e', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787079f9-be67-4e2c-861c-7ca36565f7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787079f9-be67-4e2c-861c-7ca36565f7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6e44fc-b217-48cc-bdaf-fa5ea4ab39b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:19 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Volume 3f737696-68a6-4568-affa-049f3de2528e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f737696-68a6-4568-affa-049f3de2528e', 'volume_size': 1} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T01:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-24460464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f737696-68a6-4568-affa-049f3de2528e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc9eb3ed29849a6a650985a014bdf83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T01:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T01:58:19Z,use_quota=True,user_id='beedee6ef6a44a1a8189ca06793654ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Creating volume 3f737696-68a6-4568-affa-049f3de2528e {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 03:58:19 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 03:58:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f737696-68a6-4568-affa-049f3de2528e 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:19 devstack sudo[86975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f737696-68a6-4568-affa-049f3de2528e 1073741824 Jul 01 03:58:19 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:21 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f737696-68a6-4568-affa-049f3de2528e 1073741824" returned: 0 in 1.721s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f737696-68a6-4568-affa-049f3de2528e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:21 devstack sudo[87333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f737696-68a6-4568-affa-049f3de2528e Jul 01 03:58:21 devstack sudo[87333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:22 devstack sudo[87333]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f737696-68a6-4568-affa-049f3de2528e" returned: 0 in 1.423s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] <== create_volume: return (3315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 03:58:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.319s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:58:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6e44fc-b217-48cc-bdaf-fa5ea4ab39b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f737696-68a6-4568-affa-049f3de2528e', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3ba231-f11c-4341-a932-532921bc8e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:22 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Volume volume-3f737696-68a6-4568-affa-049f3de2528e (3f737696-68a6-4568-affa-049f3de2528e): created successfully Jul 01 03:58:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3ba231-f11c-4341-a932-532921bc8e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Flow 'volume_create_manager' (b9ac29ed-48f8-41e5-b54f-64f6a61f1fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 03:58:22 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-ca40cd6b-23e2-4331-b896-3f053011cc9d tempest-DeleteServersTestJSON-747443563 None] Created volume successfully. Jul 01 03:58:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 03:58:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:58:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:58:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:58:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:58:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:58:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:24 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 03:58:24 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:25 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.122s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 03:58:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 03:58:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 6 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 03:58:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Flow 'volume_create_manager' (56fc432b-4182-47d9-a4b7-151d0ad4faf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0c59b6-1504-47fd-8ea9-8e9b76e234a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0c59b6-1504-47fd-8ea9-8e9b76e234a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T01:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-582688205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5276d09-a46d-4d9f-ac94-11667d6ec63f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64e73458e3547cebca95cf893d828c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T01:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T01:58:28Z,use_quota=True,user_id='ab8ff1eed4ea454a800522889740e753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2037433-7f98-40bb-92a8-1c11c08ce402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2037433-7f98-40bb-92a8-1c11c08ce402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155bda85-dc61-4ea5-9b9f-4893926fd46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155bda85-dc61-4ea5-9b9f-4893926fd46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5276d09-a46d-4d9f-ac94-11667d6ec63f', 'volume_name': 'volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0694a48b-79f6-440e-b6af-9a35ffd04dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0694a48b-79f6-440e-b6af-9a35ffd04dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190c7120-615f-4ede-8230-1930a86fe284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:28 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Volume c5276d09-a46d-4d9f-ac94-11667d6ec63f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f', 'volume_size': 1} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T01:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-582688205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5276d09-a46d-4d9f-ac94-11667d6ec63f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64e73458e3547cebca95cf893d828c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T01:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T01:58:28Z,use_quota=True,user_id='ab8ff1eed4ea454a800522889740e753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Creating volume c5276d09-a46d-4d9f-ac94-11667d6ec63f {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 03:58:28 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 03:58:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:28 devstack sudo[87360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f 1073741824 Jul 01 03:58:28 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:29 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 03:58:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Flow 'volume_create_manager' (3fad9b92-2bad-4470-a2d3-8e95156b6bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 03:58:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec42267-77aa-4242-b6aa-0a26b5e54787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec42267-77aa-4242-b6aa-0a26b5e54787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T01:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-373402616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3903f779-945f-4755-8dc4-0c1e97ed1e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab3a474de2147f69c2836ed7e344440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T01:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T01:58:29Z,use_quota=True,user_id='51b80dbe31fb459cbfa3ad2217a4b491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e2151d-604a-4116-8a32-e4f64c0b6ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e2151d-604a-4116-8a32-e4f64c0b6ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3be3e7c-e582-4891-8d0e-3080afccd371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3be3e7c-e582-4891-8d0e-3080afccd371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3903f779-945f-4755-8dc4-0c1e97ed1e18', 'volume_name': 'volume-3903f779-945f-4755-8dc4-0c1e97ed1e18', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28081180-42d7-4a73-9eed-1a3dcbb47a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28081180-42d7-4a73-9eed-1a3dcbb47a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2823d9a-fe1e-44a4-ba19-b02329504ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:29 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Volume 3903f779-945f-4755-8dc4-0c1e97ed1e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3903f779-945f-4755-8dc4-0c1e97ed1e18', 'volume_size': 1} Jul 01 03:58:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:58:30 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f 1073741824" returned: 0 in 2.055s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:30 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f Jul 01 03:58:30 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:31 devstack cinder-volume[86177]: WARNING py.warnings [req-7518d926-72c2-4e90-99ef-26af7ed07143 req-fae15968-d2ae-4ccb-9419-0b714a5187fc tempest-DeleteServersTestJSON-747443563 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 01 03:58:31 devstack cinder-volume[86177]: .first() Jul 01 03:58:31 devstack cinder-volume[86177]: Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-7518d926-72c2-4e90-99ef-26af7ed07143 req-fae15968-d2ae-4ccb-9419-0b714a5187fc tempest-DeleteServersTestJSON-747443563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:58:31 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f" returned: 0 in 1.169s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] <== create_volume: return (3330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.332s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.367s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T01:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-373402616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3903f779-945f-4755-8dc4-0c1e97ed1e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab3a474de2147f69c2836ed7e344440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T01:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T01:58:29Z,use_quota=True,user_id='51b80dbe31fb459cbfa3ad2217a4b491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Creating volume 3903f779-945f-4755-8dc4-0c1e97ed1e18 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 03:58:31 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3903f779-945f-4755-8dc4-0c1e97ed1e18 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:31 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3903f779-945f-4755-8dc4-0c1e97ed1e18 1073741824 Jul 01 03:58:31 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190c7120-615f-4ede-8230-1930a86fe284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb61210-c782-4d5f-bec5-10bd569be332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:31 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Volume volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f (c5276d09-a46d-4d9f-ac94-11667d6ec63f): created successfully Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb61210-c782-4d5f-bec5-10bd569be332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Flow 'volume_create_manager' (56fc432b-4182-47d9-a4b7-151d0ad4faf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 03:58:31 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-b913fe01-78e2-4cfa-9a83-b431531dd445 tempest-ServerActionsTestOtherA-1594447571 None] Created volume successfully. Jul 01 03:58:32 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3903f779-945f-4755-8dc4-0c1e97ed1e18 1073741824" returned: 0 in 1.105s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3903f779-945f-4755-8dc4-0c1e97ed1e18 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:32 devstack sudo[87421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3903f779-945f-4755-8dc4-0c1e97ed1e18 Jul 01 03:58:32 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:33 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3903f779-945f-4755-8dc4-0c1e97ed1e18" returned: 0 in 0.844s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:33 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 03:58:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:58:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-7518d926-72c2-4e90-99ef-26af7ed07143 req-fae15968-d2ae-4ccb-9419-0b714a5187fc tempest-DeleteServersTestJSON-747443563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.274s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:58:33 devstack cinder-volume[86177]: INFO oslo.privsep.daemon [req-7518d926-72c2-4e90-99ef-26af7ed07143 req-fae15968-d2ae-4ccb-9419-0b714a5187fc tempest-DeleteServersTestJSON-747443563 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8cyv50py/privsep.sock'] Jul 01 03:58:33 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8cyv50py/privsep.sock Jul 01 03:58:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2823d9a-fe1e-44a4-ba19-b02329504ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3903f779-945f-4755-8dc4-0c1e97ed1e18', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:33 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb3096f-598f-4ce1-90ac-8cc63c0aa013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:33 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Volume volume-3903f779-945f-4755-8dc4-0c1e97ed1e18 (3903f779-945f-4755-8dc4-0c1e97ed1e18): created successfully Jul 01 03:58:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb3096f-598f-4ce1-90ac-8cc63c0aa013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Flow 'volume_create_manager' (3fad9b92-2bad-4470-a2d3-8e95156b6bc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 03:58:33 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-e4180933-6b26-4c57-96d0-9839b348b098 tempest-ServersNegativeTestJSON-420448717 None] Created volume successfully. Jul 01 03:58:34 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 01 03:58:34 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 01 03:58:34 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 01 03:58:34 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: Jul 01 03:58:34 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 01 03:58:34 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 01 03:58:34 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 01 03:58:34 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: Jul 01 03:58:34 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 01 03:58:35 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 01 03:58:35 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 01 03:58:35 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 01 03:58:35 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: Jul 01 03:58:35 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 01 03:58:35 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 01 03:58:35 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 01 03:58:35 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: Jul 01 03:58:35 devstack cinder-volume[86177]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 01 03:58:35 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:35 devstack cinder-volume[86177]: INFO oslo.privsep.daemon [req-7518d926-72c2-4e90-99ef-26af7ed07143 req-fae15968-d2ae-4ccb-9419-0b714a5187fc tempest-DeleteServersTestJSON-747443563 None] Spawned new privsep daemon via rootwrap Jul 01 03:58:35 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [req-7518d926-72c2-4e90-99ef-26af7ed07143 req-fae15968-d2ae-4ccb-9419-0b714a5187fc tempest-DeleteServersTestJSON-747443563 None] Accepted privsep connection to /tmp/tmp8cyv50py/privsep.sock {{(pid=86177) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 01 03:58:35 devstack cinder-volume[86177]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 01 03:58:35 devstack cinder-volume[86177]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 01 03:58:35 devstack cinder-volume[86177]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 01 03:58:35 devstack cinder-volume[86177]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87433 Jul 01 03:58:35 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[5969ef40-0c8b-4009-a889-351ed86f844e]: (2,) {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 03:58:35 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d92c87-c0b7-4d30-b4ed-8179244a53c3]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 03:58:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-7518d926-72c2-4e90-99ef-26af7ed07143 req-fae15968-d2ae-4ccb-9419-0b714a5187fc tempest-DeleteServersTestJSON-747443563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f737696-68a6-4568-affa-049f3de2528e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:35 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f737696-68a6-4568-affa-049f3de2528e Jul 01 03:58:35 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:36 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-7518d926-72c2-4e90-99ef-26af7ed07143 req-fae15968-d2ae-4ccb-9419-0b714a5187fc tempest-DeleteServersTestJSON-747443563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f737696-68a6-4568-affa-049f3de2528e" returned: 0 in 1.043s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-7518d926-72c2-4e90-99ef-26af7ed07143 req-fae15968-d2ae-4ccb-9419-0b714a5187fc tempest-DeleteServersTestJSON-747443563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.026s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:58:36 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 03:58:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Flow 'volume_create_manager' (60720f9b-bdce-4017-a10c-30efc402374f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 03:58:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb6a17f-4ce5-4db4-aaa3-027c5a26d833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb6a17f-4ce5-4db4-aaa3-027c5a26d833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T01:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1295124923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0885959-1726-40f7-9bc0-1493b29c711f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab3a474de2147f69c2836ed7e344440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T01:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T01:58:37Z,use_quota=True,user_id='51b80dbe31fb459cbfa3ad2217a4b491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f31c1e3-7a88-48f1-ba5c-4293deb72151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f31c1e3-7a88-48f1-ba5c-4293deb72151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649aa957-5420-4978-8b8b-3f48f4e17afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649aa957-5420-4978-8b8b-3f48f4e17afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0885959-1726-40f7-9bc0-1493b29c711f', 'volume_name': 'volume-d0885959-1726-40f7-9bc0-1493b29c711f', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b0241b-4885-4040-a84d-936d378f4fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b0241b-4885-4040-a84d-936d378f4fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28c3c31-a6d3-498d-8f50-2bdb534a7590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:37 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Volume d0885959-1726-40f7-9bc0-1493b29c711f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0885959-1726-40f7-9bc0-1493b29c711f', 'volume_size': 1} Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T01:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1295124923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0885959-1726-40f7-9bc0-1493b29c711f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab3a474de2147f69c2836ed7e344440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T01:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T01:58:37Z,use_quota=True,user_id='51b80dbe31fb459cbfa3ad2217a4b491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Creating volume d0885959-1726-40f7-9bc0-1493b29c711f {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 03:58:37 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0885959-1726-40f7-9bc0-1493b29c711f 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:37 devstack sudo[87442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0885959-1726-40f7-9bc0-1493b29c711f 1073741824 Jul 01 03:58:37 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-7518d926-72c2-4e90-99ef-26af7ed07143 req-fae15968-d2ae-4ccb-9419-0b714a5187fc tempest-DeleteServersTestJSON-747443563 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-3f737696-68a6-4568-affa-049f3de2528e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73e803b0-374e-4f87-98d5-b5002999faea', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 03:58:37 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-7518d926-72c2-4e90-99ef-26af7ed07143 req-fae15968-d2ae-4ccb-9419-0b714a5187fc tempest-DeleteServersTestJSON-747443563 None] attachment_update completed successfully. Jul 01 03:58:38 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0885959-1726-40f7-9bc0-1493b29c711f 1073741824" returned: 0 in 1.189s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0885959-1726-40f7-9bc0-1493b29c711f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:38 devstack sudo[87519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0885959-1726-40f7-9bc0-1493b29c711f Jul 01 03:58:38 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:39 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0885959-1726-40f7-9bc0-1493b29c711f" returned: 0 in 1.062s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] <== create_volume: return (2359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 03:58:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.363s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:58:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28c3c31-a6d3-498d-8f50-2bdb534a7590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0885959-1726-40f7-9bc0-1493b29c711f', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294d5fc6-7745-4e03-b3f4-6a038e89c6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:58:39 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Volume volume-d0885959-1726-40f7-9bc0-1493b29c711f (d0885959-1726-40f7-9bc0-1493b29c711f): created successfully Jul 01 03:58:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294d5fc6-7745-4e03-b3f4-6a038e89c6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:58:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Flow 'volume_create_manager' (60720f9b-bdce-4017-a10c-30efc402374f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 03:58:39 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0ba8e491-1e67-4a20-9469-62daf4a3059b tempest-ServersNegativeTestJSON-420448717 None] Created volume successfully. Jul 01 03:58:41 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Acquiring lock "cinder-d0885959-1726-40f7-9bc0-1493b29c711f-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 03:58:41 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Lock "cinder-d0885959-1726-40f7-9bc0-1493b29c711f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 03:58:41 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Acquiring lock "cinder-quobyte-d0885959-1726-40f7-9bc0-1493b29c711f" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 03:58:41 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Lock "cinder-quobyte-d0885959-1726-40f7-9bc0-1493b29c711f" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 03:58:41 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e541776b-28e4-42a7-b334-dbe766ad11b7]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 03:58:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0885959-1726-40f7-9bc0-1493b29c711f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:41 devstack sudo[87855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0885959-1726-40f7-9bc0-1493b29c711f Jul 01 03:58:41 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:42 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0885959-1726-40f7-9bc0-1493b29c711f" returned: 0 in 1.140s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0885959-1726-40f7-9bc0-1493b29c711f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:42 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0885959-1726-40f7-9bc0-1493b29c711f Jul 01 03:58:42 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:43 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0885959-1726-40f7-9bc0-1493b29c711f" returned: 0 in 0.954s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Lock "cinder-quobyte-d0885959-1726-40f7-9bc0-1493b29c711f" released by "delete_volume" :: held 2.165s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 03:58:43 devstack cinder-volume[86177]: WARNING cinder.quota [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 01 03:58:43 devstack cinder-volume[86177]: WARNING cinder.quota [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 01 03:58:43 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Created reservations ['f31daace-e99e-41d9-a4b2-9e3aed993e47', '34759067-25a1-4c32-894e-8ef472d7e4b8', 'f94d7286-8615-4db2-9482-f068882aed48', 'f46f9466-8493-45d5-81c4-ea05765f6e4e'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 03:58:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:58:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:58:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:58:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:58:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:58:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:43 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 03:58:43 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:44 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.954s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:44 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 03:58:44 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Deleted volume successfully. Jul 01 03:58:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Acquiring lock "cinder-3903f779-945f-4755-8dc4-0c1e97ed1e18-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 03:58:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Lock "cinder-3903f779-945f-4755-8dc4-0c1e97ed1e18-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 03:58:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4d452e8e-93e3-4a12-9c37-62c607daf494 tempest-ServersNegativeTestJSON-420448717 None] Lock "cinder-d0885959-1726-40f7-9bc0-1493b29c711f-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 03:58:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Acquiring lock "cinder-quobyte-3903f779-945f-4755-8dc4-0c1e97ed1e18" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 03:58:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Lock "cinder-quobyte-3903f779-945f-4755-8dc4-0c1e97ed1e18" acquired by "delete_volume" :: waited 0.014s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 03:58:44 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a56a7d-590b-43e9-b2ff-6f666df45daf]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 03:58:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3903f779-945f-4755-8dc4-0c1e97ed1e18 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:44 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3903f779-945f-4755-8dc4-0c1e97ed1e18 Jul 01 03:58:44 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:45 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3903f779-945f-4755-8dc4-0c1e97ed1e18" returned: 0 in 0.877s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3903f779-945f-4755-8dc4-0c1e97ed1e18 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:45 devstack sudo[87946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3903f779-945f-4755-8dc4-0c1e97ed1e18 Jul 01 03:58:45 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:46 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3903f779-945f-4755-8dc4-0c1e97ed1e18" returned: 0 in 0.881s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Lock "cinder-quobyte-3903f779-945f-4755-8dc4-0c1e97ed1e18" released by "delete_volume" :: held 1.813s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 03:58:46 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Created reservations ['13c5d658-66b9-42da-9b9f-c9124a91b211', '0bda9ed9-7181-42f1-9785-2b87361ff237', '57a496be-2401-415d-80c4-196a0f503017', '8a281af4-2dba-486d-84e1-06236dcce210'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 03:58:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:58:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:58:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:58:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:58:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:58:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:46 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 03:58:46 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:47 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-b3c46e6c-7bec-4d7e-923d-423205b0400e req-318d967a-65c9-4275-8e88-fb531039d378 tempest-DeleteServersTestJSON-747443563 None] Terminate volume connection completed successfully. Jul 01 03:58:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-b3c46e6c-7bec-4d7e-923d-423205b0400e req-318d967a-65c9-4275-8e88-fb531039d378 tempest-DeleteServersTestJSON-747443563 None] Deleting attachment 73e803b0-374e-4f87-98d5-b5002999faea. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 03:58:48 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.385s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:48 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 03:58:48 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Deleted volume successfully. Jul 01 03:58:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2d9f0cfc-37ce-428b-b7eb-b5ffcd944cec tempest-ServersNegativeTestJSON-420448717 None] Lock "cinder-3903f779-945f-4755-8dc4-0c1e97ed1e18-delete_volume" released by "delete_volume" :: held 3.571s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 03:58:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Acquiring lock "cinder-3f737696-68a6-4568-affa-049f3de2528e-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 03:58:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Lock "cinder-3f737696-68a6-4568-affa-049f3de2528e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 03:58:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Acquiring lock "cinder-quobyte-3f737696-68a6-4568-affa-049f3de2528e" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 03:58:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Lock "cinder-quobyte-3f737696-68a6-4568-affa-049f3de2528e" acquired by "delete_volume" :: waited 0.024s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 03:58:52 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37b4f53-e72a-4124-a0b9-e8979d8b5cce]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 03:58:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f737696-68a6-4568-affa-049f3de2528e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:52 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f737696-68a6-4568-affa-049f3de2528e Jul 01 03:58:52 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:53 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f737696-68a6-4568-affa-049f3de2528e" returned: 0 in 1.198s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f737696-68a6-4568-affa-049f3de2528e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:53 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f737696-68a6-4568-affa-049f3de2528e Jul 01 03:58:53 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:54 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f737696-68a6-4568-affa-049f3de2528e" returned: 0 in 0.900s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Lock "cinder-quobyte-3f737696-68a6-4568-affa-049f3de2528e" released by "delete_volume" :: held 2.155s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 03:58:54 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Created reservations ['860cdbaf-bfb9-42d6-84b2-92a0b6a9e3ac', '7dbf58ce-0081-4d2a-9147-67ecab6935a4', '833a244e-a3cd-4d0e-85fb-749417b4014e', '6656e1c8-75cd-4904-9cf7-2096dbb4d254'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 03:58:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:58:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:58:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:58:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:58:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:58:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:58:55 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 03:58:55 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:58:56 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Jul 01 03:58:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.004s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:58:56 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 03:58:56 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Deleted volume successfully. Jul 01 03:58:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-44c5d7ca-a290-4f8e-8abd-5cea7d6c412c tempest-DeleteServersTestJSON-747443563 None] Lock "cinder-3f737696-68a6-4568-affa-049f3de2528e-delete_volume" released by "delete_volume" :: held 3.502s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 03:59:05 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=27,cinder:UPDATE=36,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 03:59:10 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=40,cinder:SELECT=33,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 03:59:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-2855cf0f-7676-48d6-bd1f-016135da44b8 req-3d0ce57b-554b-4e36-9e66-ccb697aabf2a tempest-ServerActionsTestOtherA-1594447571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:59:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-2855cf0f-7676-48d6-bd1f-016135da44b8 req-3d0ce57b-554b-4e36-9e66-ccb697aabf2a tempest-ServerActionsTestOtherA-1594447571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:59:19 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36f3278-bbe3-4921-adf7-cc6557d68945]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 03:59:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-2855cf0f-7676-48d6-bd1f-016135da44b8 req-3d0ce57b-554b-4e36-9e66-ccb697aabf2a tempest-ServerActionsTestOtherA-1594447571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:59:19 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f Jul 01 03:59:19 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:59:20 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Jul 01 03:59:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-2855cf0f-7676-48d6-bd1f-016135da44b8 req-3d0ce57b-554b-4e36-9e66-ccb697aabf2a tempest-ServerActionsTestOtherA-1594447571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f" returned: 0 in 0.907s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:59:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-2855cf0f-7676-48d6-bd1f-016135da44b8 req-3d0ce57b-554b-4e36-9e66-ccb697aabf2a tempest-ServerActionsTestOtherA-1594447571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.932s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:59:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-2855cf0f-7676-48d6-bd1f-016135da44b8 req-3d0ce57b-554b-4e36-9e66-ccb697aabf2a tempest-ServerActionsTestOtherA-1594447571 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f02e52a3-0ff9-4265-acf3-f8a551717b03', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 03:59:20 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-2855cf0f-7676-48d6-bd1f-016135da44b8 req-3d0ce57b-554b-4e36-9e66-ccb697aabf2a tempest-ServerActionsTestOtherA-1594447571 None] attachment_update completed successfully. Jul 01 03:59:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 03:59:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:59:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:59:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:59:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:59:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:59:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:59:24 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 03:59:24 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:59:25 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Jul 01 03:59:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.013s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:59:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 03:59:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 03:59:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 8 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 03:59:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 03:59:30 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=6 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 03:59:30 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 03:59:33 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-d8521dda-4904-4e95-8e18-97d8dc3e1cc5 req-1b37299f-cb59-424a-bf4f-e63287cb707d tempest-ServerActionsTestOtherA-1594447571 None] Terminate volume connection completed successfully. Jul 01 03:59:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-d8521dda-4904-4e95-8e18-97d8dc3e1cc5 req-1b37299f-cb59-424a-bf4f-e63287cb707d tempest-ServerActionsTestOtherA-1594447571 None] Deleting attachment f02e52a3-0ff9-4265-acf3-f8a551717b03. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Flow 'volume_create_manager' (567d62f9-0197-4bce-b8e0-85179ceb6ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0e8ff9-a4f0-4398-ac6e-6cec444f0fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0e8ff9-a4f0-4398-ac6e-6cec444f0fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T01:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2107807988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacb4da4-60db-4bda-8938-06ee73544e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2db8989ee014f38945435da7af82efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T01:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T01:59:35Z,use_quota=True,user_id='de517a6773d84d7b894b4a98cccd262c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b35167f-c893-4263-9adb-3a84beb7b489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b35167f-c893-4263-9adb-3a84beb7b489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab5fc4b-d721-4723-8a4c-ce6d0947e8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab5fc4b-d721-4723-8a4c-ce6d0947e8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eacb4da4-60db-4bda-8938-06ee73544e1d', 'volume_name': 'volume-eacb4da4-60db-4bda-8938-06ee73544e1d', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0c2ae9-7a89-4b97-8643-0bce2be9fe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0c2ae9-7a89-4b97-8643-0bce2be9fe84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb7b0e6-b27e-4275-a5d1-b9095f4464bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:59:35 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Volume eacb4da4-60db-4bda-8938-06ee73544e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eacb4da4-60db-4bda-8938-06ee73544e1d', 'volume_size': 1} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T01:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2107807988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacb4da4-60db-4bda-8938-06ee73544e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2db8989ee014f38945435da7af82efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T01:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T01:59:35Z,use_quota=True,user_id='de517a6773d84d7b894b4a98cccd262c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Creating volume eacb4da4-60db-4bda-8938-06ee73544e1d {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 03:59:35 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 03:59:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eacb4da4-60db-4bda-8938-06ee73544e1d 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:59:35 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eacb4da4-60db-4bda-8938-06ee73544e1d 1073741824 Jul 01 03:59:35 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:59:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-d8521dda-4904-4e95-8e18-97d8dc3e1cc5 req-5a80c121-ee27-4ebd-b25a-78e80892e46e tempest-ServerActionsTestOtherA-1594447571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:59:36 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Jul 01 03:59:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eacb4da4-60db-4bda-8938-06ee73544e1d 1073741824" returned: 0 in 1.115s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:59:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eacb4da4-60db-4bda-8938-06ee73544e1d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:59:36 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eacb4da4-60db-4bda-8938-06ee73544e1d Jul 01 03:59:36 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:59:37 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Jul 01 03:59:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eacb4da4-60db-4bda-8938-06ee73544e1d" returned: 0 in 0.839s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:59:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 03:59:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:59:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-d8521dda-4904-4e95-8e18-97d8dc3e1cc5 req-5a80c121-ee27-4ebd-b25a-78e80892e46e tempest-ServerActionsTestOtherA-1594447571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.955s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:59:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb7b0e6-b27e-4275-a5d1-b9095f4464bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eacb4da4-60db-4bda-8938-06ee73544e1d', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:59:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d5e86a-1b1a-4d3c-ad15-b4c47e1992c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:59:37 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c245bc0-c6ba-4665-b835-971bda57a38f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 03:59:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-d8521dda-4904-4e95-8e18-97d8dc3e1cc5 req-5a80c121-ee27-4ebd-b25a-78e80892e46e tempest-ServerActionsTestOtherA-1594447571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:59:37 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Volume volume-eacb4da4-60db-4bda-8938-06ee73544e1d (eacb4da4-60db-4bda-8938-06ee73544e1d): created successfully Jul 01 03:59:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d5e86a-1b1a-4d3c-ad15-b4c47e1992c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:59:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Flow 'volume_create_manager' (567d62f9-0197-4bce-b8e0-85179ceb6ae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 03:59:37 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1438a7d2-1ae4-463d-a840-280e0c1f7a14 tempest-TaggedAttachmentsTest-1774711315 None] Created volume successfully. Jul 01 03:59:37 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f Jul 01 03:59:37 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:59:38 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Jul 01 03:59:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-d8521dda-4904-4e95-8e18-97d8dc3e1cc5 req-5a80c121-ee27-4ebd-b25a-78e80892e46e tempest-ServerActionsTestOtherA-1594447571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f" returned: 0 in 0.832s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:59:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-d8521dda-4904-4e95-8e18-97d8dc3e1cc5 req-5a80c121-ee27-4ebd-b25a-78e80892e46e tempest-ServerActionsTestOtherA-1594447571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.866s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:59:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-d8521dda-4904-4e95-8e18-97d8dc3e1cc5 req-5a80c121-ee27-4ebd-b25a-78e80892e46e tempest-ServerActionsTestOtherA-1594447571 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd71cafc0-0eda-4f1f-92d9-2c691552f8a5', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 03:59:38 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-d8521dda-4904-4e95-8e18-97d8dc3e1cc5 req-5a80c121-ee27-4ebd-b25a-78e80892e46e tempest-ServerActionsTestOtherA-1594447571 None] attachment_update completed successfully. Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Flow 'volume_create_manager' (cb45ddad-64dc-45b1-9edf-1a7ec4f8288b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639fc37b-aaf4-411a-90cc-9a87f42d44f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639fc37b-aaf4-411a-90cc-9a87f42d44f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T01:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1002302744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14d5a6d-3b8f-4dbc-826d-af72d0627ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1234a2b76f4c3e80bd76f9f48ac36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T01:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T01:59:40Z,use_quota=True,user_id='0e5a2cb75a1546fdb534c02f08beb37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1799afc-3031-451b-a13c-1ca704ab96c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1799afc-3031-451b-a13c-1ca704ab96c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70857ecc-b55e-4481-bbfd-b38350150281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70857ecc-b55e-4481-bbfd-b38350150281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14d5a6d-3b8f-4dbc-826d-af72d0627ba2', 'volume_name': 'volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b056734-84d0-40c2-9890-9093d89b7f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b056734-84d0-40c2-9890-9093d89b7f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da2e7d2-e9c2-492f-8a40-6055b93c9387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:59:40 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Volume f14d5a6d-3b8f-4dbc-826d-af72d0627ba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2', 'volume_size': 1} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T01:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1002302744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14d5a6d-3b8f-4dbc-826d-af72d0627ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1234a2b76f4c3e80bd76f9f48ac36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T01:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T01:59:40Z,use_quota=True,user_id='0e5a2cb75a1546fdb534c02f08beb37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Creating volume f14d5a6d-3b8f-4dbc-826d-af72d0627ba2 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 03:59:40 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 03:59:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:59:40 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2 1073741824 Jul 01 03:59:40 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:59:42 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Jul 01 03:59:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2 1073741824" returned: 0 in 1.782s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:59:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:59:42 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2 Jul 01 03:59:42 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:59:43 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Jul 01 03:59:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2" returned: 0 in 0.963s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:59:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] <== create_volume: return (2844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 03:59:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.851s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:59:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da2e7d2-e9c2-492f-8a40-6055b93c9387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:59:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47f9ef4-740b-418e-b632-9612144721f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 03:59:43 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Volume volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2 (f14d5a6d-3b8f-4dbc-826d-af72d0627ba2): created successfully Jul 01 03:59:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47f9ef4-740b-418e-b632-9612144721f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 03:59:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Flow 'volume_create_manager' (cb45ddad-64dc-45b1-9edf-1a7ec4f8288b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 03:59:43 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-14a0ff77-b911-434c-80a3-fb0895e0063a tempest-VolumesAdminNegativeTest-457991247 None] Created volume successfully. Jul 01 03:59:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Acquiring lock "cinder-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 03:59:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Lock "cinder-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 03:59:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Acquiring lock "cinder-quobyte-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 03:59:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Lock "cinder-quobyte-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2" acquired by "delete_volume" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 03:59:45 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e1ea06-35fb-40b3-8b29-8e044926e8e9]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 03:59:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:59:45 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2 Jul 01 03:59:45 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:59:47 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Jul 01 03:59:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2" returned: 0 in 2.033s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:59:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:59:47 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2 Jul 01 03:59:47 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:59:48 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Jul 01 03:59:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2" returned: 0 in 1.075s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:59:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Lock "cinder-quobyte-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2" released by "delete_volume" :: held 3.220s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 03:59:48 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Created reservations ['ebab0e8a-bad3-40e5-a638-10a1b1725647', '22af8977-fd6e-48f0-8e83-8fc0e618322c', '4e71b011-bd50-47e8-988e-2b1058e0d05c', '142ef0fe-1ef8-44ae-b18d-328bea626474'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 03:59:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 03:59:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 03:59:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 03:59:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 03:59:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 03:59:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 03:59:48 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 03:59:48 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 03:59:50 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Jul 01 03:59:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 2.042s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 03:59:50 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 03:59:50 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Deleted volume successfully. Jul 01 03:59:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5cce9b0a-591b-48a2-a953-d8fc27967c59 tempest-VolumesAdminNegativeTest-457991247 None] Lock "cinder-f14d5a6d-3b8f-4dbc-826d-af72d0627ba2-delete_volume" released by "delete_volume" :: held 5.796s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 03:59:58 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=16,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:00:00 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=15,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:00:15 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-0512ebaa-c0f8-4f94-a2bb-760b108813d5 req-c08652eb-f998-489f-9e07-6a074e221cb4 tempest-ServerActionsTestOtherA-1594447571 None] Terminate volume connection completed successfully. Jul 01 04:00:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0512ebaa-c0f8-4f94-a2bb-760b108813d5 req-c08652eb-f998-489f-9e07-6a074e221cb4 tempest-ServerActionsTestOtherA-1594447571 None] Deleting attachment d71cafc0-0eda-4f1f-92d9-2c691552f8a5. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Flow 'volume_create_manager' (b0383338-6cb8-4d69-8e26-208b44c0fc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0accd44c-fde5-43f3-8663-5b40bd3564b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0accd44c-fde5-43f3-8663-5b40bd3564b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-720857950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfd59a5-8310-4a10-90e0-6040c572ac6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2c68bbc8fa414aa9365dbdc4d91c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:00:18Z,use_quota=True,user_id='bed84f432ac84999b4f35bd3731459d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf295a7a-0d91-404b-87b1-625c917c2968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf295a7a-0d91-404b-87b1-625c917c2968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a92f1b-8cfd-4257-a7b8-87fbb6a556d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a92f1b-8cfd-4257-a7b8-87fbb6a556d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdfd59a5-8310-4a10-90e0-6040c572ac6a', 'volume_name': 'volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249942b9-0338-44e8-90e4-1e69bb4cde82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249942b9-0338-44e8-90e4-1e69bb4cde82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68c3c00-f10e-406e-83c1-b6bc5f372e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:18 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Volume cdfd59a5-8310-4a10-90e0-6040c572ac6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a', 'volume_size': 1} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-720857950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfd59a5-8310-4a10-90e0-6040c572ac6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2c68bbc8fa414aa9365dbdc4d91c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:00:18Z,use_quota=True,user_id='bed84f432ac84999b4f35bd3731459d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Creating volume cdfd59a5-8310-4a10-90e0-6040c572ac6a {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:00:18 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:18 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a 1073741824 Jul 01 04:00:18 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:18 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a 1073741824" returned: 0 in 0.870s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:19 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a Jul 01 04:00:19 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:19 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a" returned: 0 in 0.921s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:00:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:00:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68c3c00-f10e-406e-83c1-b6bc5f372e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c9c4e7-420e-4081-a12b-2fb7996c2cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:19 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Volume volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a (cdfd59a5-8310-4a10-90e0-6040c572ac6a): created successfully Jul 01 04:00:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c9c4e7-420e-4081-a12b-2fb7996c2cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Flow 'volume_create_manager' (b0383338-6cb8-4d69-8e26-208b44c0fc39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:00:20 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-48cdca3d-08d5-479c-863b-99901497bf21 tempest-AttachVolumeTestJSON-133197759 None] Created volume successfully. Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Flow 'volume_create_manager' (8a174516-93c2-410f-8282-905f091067d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e6b3ed-22e4-41d4-b11f-eba99569ec32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e6b3ed-22e4-41d4-b11f-eba99569ec32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1459978558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0fb8d0f-8ed9-414f-8c97-0db618b86355,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='00eb1ae3f6cb46d38ec0042ec9eb7bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:00:21Z,use_quota=True,user_id='8afa05d14c1d4614937668ffe2e799bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6376e1e4-887d-442d-9743-fbe934e08382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6376e1e4-887d-442d-9743-fbe934e08382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0298e237-559d-4518-8f61-5de7694e38f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0298e237-559d-4518-8f61-5de7694e38f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0fb8d0f-8ed9-414f-8c97-0db618b86355', 'volume_name': 'volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba96836-c5d3-4812-8492-cb18a0062e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba96836-c5d3-4812-8492-cb18a0062e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a8c4ff-14be-4ec5-90c1-4e9404cb723b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:21 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Volume d0fb8d0f-8ed9-414f-8c97-0db618b86355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355', 'volume_size': 1} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1459978558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0fb8d0f-8ed9-414f-8c97-0db618b86355,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='00eb1ae3f6cb46d38ec0042ec9eb7bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:00:21Z,use_quota=True,user_id='8afa05d14c1d4614937668ffe2e799bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Creating volume d0fb8d0f-8ed9-414f-8c97-0db618b86355 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:00:21 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:00:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:21 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355 1073741824 Jul 01 04:00:21 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:22 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355 1073741824" returned: 0 in 0.848s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:22 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355 Jul 01 04:00:22 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:23 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355" returned: 0 in 0.668s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:00:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:00:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a8c4ff-14be-4ec5-90c1-4e9404cb723b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7783f19-7751-48e4-a8f7-7c759e5095a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:23 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Volume volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355 (d0fb8d0f-8ed9-414f-8c97-0db618b86355): created successfully Jul 01 04:00:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7783f19-7751-48e4-a8f7-7c759e5095a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Flow 'volume_create_manager' (8a174516-93c2-410f-8282-905f091067d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:00:23 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-eb42861b-c09c-43ca-a61f-b43d9c3c0eef req-5526a565-03c9-47bf-b92d-090362ac9d6f tempest-VolumesGetTestJSON-162212423 None] Created volume successfully. Jul 01 04:00:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-8f6499cb-31a2-470c-a706-96dc25f08106 req-d169bff4-bc54-4626-b9a8-dcec492a85a0 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:00:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-8f6499cb-31a2-470c-a706-96dc25f08106 req-d169bff4-bc54-4626-b9a8-dcec492a85a0 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:00:23 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebbb433-dbba-4e1a-bfc9-9c5494a171e0]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:00:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-8f6499cb-31a2-470c-a706-96dc25f08106 req-d169bff4-bc54-4626-b9a8-dcec492a85a0 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:23 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a Jul 01 04:00:23 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Acquiring lock "cinder-d0fb8d0f-8ed9-414f-8c97-0db618b86355-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Lock "cinder-d0fb8d0f-8ed9-414f-8c97-0db618b86355-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Acquiring lock "cinder-quobyte-d0fb8d0f-8ed9-414f-8c97-0db618b86355" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Lock "cinder-quobyte-d0fb8d0f-8ed9-414f-8c97-0db618b86355" acquired by "delete_volume" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf60ffb-ac86-4d30-a434-fc3631e895f1]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:24 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-8f6499cb-31a2-470c-a706-96dc25f08106 req-d169bff4-bc54-4626-b9a8-dcec492a85a0 tempest-AttachVolumeTestJSON-133197759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a" returned: 0 in 0.878s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-8f6499cb-31a2-470c-a706-96dc25f08106 req-d169bff4-bc54-4626-b9a8-dcec492a85a0 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.899s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-8f6499cb-31a2-470c-a706-96dc25f08106 req-d169bff4-bc54-4626-b9a8-dcec492a85a0 tempest-AttachVolumeTestJSON-133197759 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32ce6f19-ebf3-4e0d-aeff-3db6ad4d8fa4', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:00:24 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-8f6499cb-31a2-470c-a706-96dc25f08106 req-d169bff4-bc54-4626-b9a8-dcec492a85a0 tempest-AttachVolumeTestJSON-133197759 None] attachment_update completed successfully. Jul 01 04:00:24 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355 Jul 01 04:00:24 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:00:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:24 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:00:24 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:25 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355" returned: 0 in 0.833s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:25 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355 Jul 01 04:00:25 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:25 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.772s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:00:25 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d0fb8d0f-8ed9-414f-8c97-0db618b86355" returned: 0 in 0.779s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Lock "cinder-quobyte-d0fb8d0f-8ed9-414f-8c97-0db618b86355" released by "delete_volume" :: held 1.693s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:00:25 devstack cinder-volume[86177]: DEBUG cinder.quota [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Created reservations ['4fcb9191-1e85-4f2f-8cc4-049c5dbc130a', '8444460f-3c02-41b7-b4f8-38f099a4ba98', '5768ab2c-84d9-4558-8065-fdba2e82eb77', '3a068123-1895-4b3c-92cb-c125ca22ca62'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:00:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:00:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:00:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:00:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:00:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:00:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:26 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:00:26 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Acquiring lock "cinder-c5276d09-a46d-4d9f-ac94-11667d6ec63f-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:00:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Lock "cinder-c5276d09-a46d-4d9f-ac94-11667d6ec63f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:00:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Acquiring lock "cinder-quobyte-c5276d09-a46d-4d9f-ac94-11667d6ec63f" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:00:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Lock "cinder-quobyte-c5276d09-a46d-4d9f-ac94-11667d6ec63f" acquired by "delete_volume" :: waited 0.022s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:00:26 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6594c3a3-a617-4fda-8418-7a7dab9891ae]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:00:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:26 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f Jul 01 04:00:26 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:26 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.694s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:26 devstack cinder-volume[86177]: DEBUG cinder.manager [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:00:26 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Deleted volume successfully. Jul 01 04:00:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-9af8de4b-5e9b-4a35-9c9d-e36fdab8bd17 req-6ec6ae2f-ab10-46c2-8526-bf4fac9f34e5 tempest-VolumesGetTestJSON-162212423 None] Lock "cinder-d0fb8d0f-8ed9-414f-8c97-0db618b86355-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:00:27 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f" returned: 0 in 0.863s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:27 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f Jul 01 04:00:27 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:27 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5276d09-a46d-4d9f-ac94-11667d6ec63f" returned: 0 in 0.713s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Lock "cinder-quobyte-c5276d09-a46d-4d9f-ac94-11667d6ec63f" released by "delete_volume" :: held 1.620s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:00:27 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Created reservations ['fcca047a-05c0-4d45-9f9f-388f31055234', 'cf7a0643-6344-4e10-84fb-931838297d80', '29210054-17e6-4bb0-acb1-0b9d736e918c', '7bf41e16-c5f8-4137-9f08-3e943a6c1474'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:00:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:00:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:00:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:00:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:00:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:00:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:27 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:00:27 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:28 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.795s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:28 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:00:28 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Deleted volume successfully. Jul 01 04:00:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-af020de3-03e8-4e6e-9e8a-f962ea03725d tempest-ServerActionsTestOtherA-1594447571 None] Lock "cinder-c5276d09-a46d-4d9f-ac94-11667d6ec63f-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:00:31 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1b71cae0-8316-480c-9294-743307465724 tempest-GroupSnapshotsV319Test-37185426 None] Group tempest-GroupSnapshotsV319Test-Group-462878307: creating Jul 01 04:00:31 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1b71cae0-8316-480c-9294-743307465724 tempest-GroupSnapshotsV319Test-37185426 None] Group tempest-GroupSnapshotsV319Test-Group-462878307: created successfully Jul 01 04:00:31 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1b71cae0-8316-480c-9294-743307465724 tempest-GroupSnapshotsV319Test-37185426 None] Create group completed successfully. Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Flow 'volume_create_manager' (b77e7c32-a39c-4ca7-9b88-bbcfb11d5ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf92835b-5d93-4918-afb2-554b42998b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf92835b-5d93-4918-afb2-554b42998b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1667811855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66eb067c-e32f-4196-84e1-9c1a47eed359,host='devstack@QuobyteHD#QuobyteHD',id=e2d29014-9ec7-403a-b613-773f31a4256b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985c5d93b8c646b3ba764bc319b6a431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:00:33Z,use_quota=True,user_id='88bf32dfb1d9435fb4d35399bc6585b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bbbb0a9-a76f-4b78-92e8-665ce1680417),volume_type_id=7bbbb0a9-a76f-4b78-92e8-665ce1680417)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d46602-a820-458d-82d6-03686a3e80a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d46602-a820-458d-82d6-03686a3e80a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3dae17-2d9d-4e77-a17d-0bb77e0dcf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3dae17-2d9d-4e77-a17d-0bb77e0dcf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2d29014-9ec7-403a-b613-773f31a4256b', 'volume_name': 'volume-e2d29014-9ec7-403a-b613-773f31a4256b', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9230e3-0e1d-4cf5-ae5f-015ffd90430e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9230e3-0e1d-4cf5-ae5f-015ffd90430e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d6395c-2f97-44be-bea4-7a8dd6bb5f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:33 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Volume e2d29014-9ec7-403a-b613-773f31a4256b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2d29014-9ec7-403a-b613-773f31a4256b', 'volume_size': 1} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66eb067c-e32f-4196-84e1-9c1a47eed359,created_at=2026-07-01T02:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1667811855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66eb067c-e32f-4196-84e1-9c1a47eed359,host='devstack@QuobyteHD#QuobyteHD',id=e2d29014-9ec7-403a-b613-773f31a4256b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985c5d93b8c646b3ba764bc319b6a431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:00:33Z,use_quota=True,user_id='88bf32dfb1d9435fb4d35399bc6585b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bbbb0a9-a76f-4b78-92e8-665ce1680417),volume_type_id=7bbbb0a9-a76f-4b78-92e8-665ce1680417)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Creating volume e2d29014-9ec7-403a-b613-773f31a4256b {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:00:33 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:00:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:33 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b 1073741824 Jul 01 04:00:33 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:34 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b 1073741824" returned: 0 in 0.997s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:34 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b Jul 01 04:00:34 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:35 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b" returned: 0 in 1.173s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:35 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] <== create_volume: return (2226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:00:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.231s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:00:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d6395c-2f97-44be-bea4-7a8dd6bb5f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2d29014-9ec7-403a-b613-773f31a4256b', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2a3e4f-5f14-4494-8955-46becdf1f0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:00:35 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Volume volume-e2d29014-9ec7-403a-b613-773f31a4256b (e2d29014-9ec7-403a-b613-773f31a4256b): created successfully Jul 01 04:00:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2a3e4f-5f14-4494-8955-46becdf1f0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:00:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Flow 'volume_create_manager' (b77e7c32-a39c-4ca7-9b88-bbcfb11d5ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:00:35 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-73291f83-ae0f-4854-b97c-1143989025e5 tempest-GroupSnapshotsV319Test-37185426 None] Created volume successfully. Jul 01 04:00:37 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] GroupSnapshot d5b54117-d67f-4224-a5c2-8b870d01f2a9: creating. Jul 01 04:00:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] Group snapshot d5b54117-d67f-4224-a5c2-8b870d01f2a9: creating. {{(pid=86177) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 01 04:00:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:00:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:00:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] Creating offline snapshot defce212-4205-4616-b17b-7f0208100136 of volume e2d29014-9ec7-403a-b613-773f31a4256b {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:00:37 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fd35f4-e915-4325-8929-b56c5d2322be]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:00:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:37 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b Jul 01 04:00:37 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:38 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b" returned: 0 in 0.763s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:38 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136 1G Jul 01 04:00:38 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:39 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136 1G" returned: 0 in 0.945s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2d29014-9ec7-403a-b613-773f31a4256b -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:39 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2d29014-9ec7-403a-b613-773f31a4256b -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136 Jul 01 04:00:39 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:39 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2d29014-9ec7-403a-b613-773f31a4256b -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136" returned: 0 in 0.735s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:39 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136 is being set with open permissions: ugo+rw: NotImplementedError Jul 01 04:00:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:39 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136 Jul 01 04:00:39 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:40 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136" returned: 0 in 0.691s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:40 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.info Jul 01 04:00:40 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:41 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.info" returned: 0 in 0.786s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:41 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 01 04:00:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:41 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.info Jul 01 04:00:41 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-0b1ee0e6-e848-450f-97fb-a8e3a1071a38 req-8b12b7bb-d5ff-4119-a803-0c1183a2371e tempest-TaggedAttachmentsTest-1774711315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:00:42 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.info" returned: 0 in 0.808s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.821s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:00:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-0b1ee0e6-e848-450f-97fb-a8e3a1071a38 req-8b12b7bb-d5ff-4119-a803-0c1183a2371e tempest-TaggedAttachmentsTest-1774711315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.208s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:00:42 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4ce262-1add-4864-ba3e-1c6bf8a5814b]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:00:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-0b1ee0e6-e848-450f-97fb-a8e3a1071a38 req-8b12b7bb-d5ff-4119-a803-0c1183a2371e tempest-TaggedAttachmentsTest-1774711315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eacb4da4-60db-4bda-8938-06ee73544e1d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:42 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-372a302f-5cf6-45f4-97a1-54823fe542b2 tempest-GroupSnapshotsV319Test-37185426 None] group_snapshot d5b54117-d67f-4224-a5c2-8b870d01f2a9: created successfully Jul 01 04:00:42 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eacb4da4-60db-4bda-8938-06ee73544e1d Jul 01 04:00:42 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:43 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-0b1ee0e6-e848-450f-97fb-a8e3a1071a38 req-8b12b7bb-d5ff-4119-a803-0c1183a2371e tempest-TaggedAttachmentsTest-1774711315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eacb4da4-60db-4bda-8938-06ee73544e1d" returned: 0 in 1.262s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-0b1ee0e6-e848-450f-97fb-a8e3a1071a38 req-8b12b7bb-d5ff-4119-a803-0c1183a2371e tempest-TaggedAttachmentsTest-1774711315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.300s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:00:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0b1ee0e6-e848-450f-97fb-a8e3a1071a38 req-8b12b7bb-d5ff-4119-a803-0c1183a2371e tempest-TaggedAttachmentsTest-1774711315 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-eacb4da4-60db-4bda-8938-06ee73544e1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff1c68f1-3cc1-4f66-981b-70f48e9a04fe', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:00:43 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-0b1ee0e6-e848-450f-97fb-a8e3a1071a38 req-8b12b7bb-d5ff-4119-a803-0c1183a2371e tempest-TaggedAttachmentsTest-1774711315 None] attachment_update completed successfully. Jul 01 04:00:43 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] group_snapshot d5b54117-d67f-4224-a5c2-8b870d01f2a9: deleting Jul 01 04:00:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] group_snapshot d5b54117-d67f-4224-a5c2-8b870d01f2a9: deleting {{(pid=86177) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 01 04:00:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] Acquiring lock "cinder-quobyte-e2d29014-9ec7-403a-b613-773f31a4256b" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:00:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] Lock "cinder-quobyte-e2d29014-9ec7-403a-b613-773f31a4256b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:00:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] Acquiring lock "cinder-quobyte-defce212-4205-4616-b17b-7f0208100136" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:00:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] Lock "cinder-quobyte-defce212-4205-4616-b17b-7f0208100136" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:00:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] Deleting offline snapshot defce212-4205-4616-b17b-7f0208100136 of volume e2d29014-9ec7-403a-b613-773f31a4256b {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:00:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] snapshot_file for this snap is: volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:00:44 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dac4ddd-3c05-4571-8185-b13feb294664]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:00:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:44 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136 Jul 01 04:00:44 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:45 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136" returned: 0 in 1.005s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:45 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2d29014-9ec7-403a-b613-773f31a4256b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:00:45 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3102a35b-183a-45d7-9949-78dcb0e2048c]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:00:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:45 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b Jul 01 04:00:45 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:46 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b" returned: 0 in 1.011s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:46 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136 Jul 01 04:00:46 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:47 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136" returned: 0 in 1.121s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:47 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136 Jul 01 04:00:47 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:48 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b.defce212-4205-4616-b17b-7f0208100136" returned: 0 in 1.018s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] Lock "cinder-quobyte-defce212-4205-4616-b17b-7f0208100136" released by "_delete_snapshot" :: held 4.347s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:00:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] Lock "cinder-quobyte-e2d29014-9ec7-403a-b613-773f31a4256b" released by "delete_snapshot" :: held 4.381s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:00:48 devstack cinder-volume[86177]: WARNING cinder.quota [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1669784539 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1669784539, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:00:48 devstack cinder-volume[86177]: WARNING cinder.quota [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1669784539 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1669784539, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:00:48 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] Created reservations ['9c582db0-c99f-45ba-b0a7-a4ad3feab321', '1d0ceeae-f421-4cc1-a9ed-4182d39a9710', '1d3b95cd-a506-44d8-af49-cfa975d9ab70', '46dca34f-5895-4df8-9d5a-92a73628f70d'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:00:48 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-ed549157-4703-4b30-a3a0-cb7ae1fb18aa tempest-GroupSnapshotsV319Test-37185426 None] group_snapshot d5b54117-d67f-4224-a5c2-8b870d01f2a9: deleted successfully Jul 01 04:00:49 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Acquiring lock "cinder-quobyte-e2d29014-9ec7-403a-b613-773f31a4256b" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:00:49 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Lock "cinder-quobyte-e2d29014-9ec7-403a-b613-773f31a4256b" acquired by "delete_volume" :: waited 0.028s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:00:49 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4aaf22-bfdc-460d-b5b2-28ef90b69ea0]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:00:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:49 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b Jul 01 04:00:49 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:50 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b" returned: 0 in 0.925s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:50 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b Jul 01 04:00:50 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:50 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-66103790-0ce2-44ae-b56c-c9166d40ee4d req-00cda5e2-c162-49e9-8e3d-08a87ce30166 tempest-TaggedAttachmentsTest-1774711315 None] Terminate volume connection completed successfully. Jul 01 04:00:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-66103790-0ce2-44ae-b56c-c9166d40ee4d req-00cda5e2-c162-49e9-8e3d-08a87ce30166 tempest-TaggedAttachmentsTest-1774711315 None] Deleting attachment ff1c68f1-3cc1-4f66-981b-70f48e9a04fe. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:00:50 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e2d29014-9ec7-403a-b613-773f31a4256b" returned: 0 in 0.813s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Lock "cinder-quobyte-e2d29014-9ec7-403a-b613-773f31a4256b" released by "delete_volume" :: held 1.801s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:00:51 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Created reservations ['d64785bd-7bab-4e12-9695-2e4b33eda6e2'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:00:51 devstack cinder-volume[86177]: WARNING cinder.quota [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1669784539 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1669784539, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:00:51 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Created reservations ['c5a87ceb-5010-406d-bd07-169db004c176', 'a202ebe2-c21b-4c47-8e1b-7318e10e5ecc', '13dcbaa3-93be-4558-a70e-0cfff223eca0', '61393508-0eb3-42e3-98e5-1f03a3ee11be'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:00:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:00:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:00:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:00:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:00:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:00:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:00:51 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:00:51 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:00:52 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Jul 01 04:00:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.065s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:00:52 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:00:52 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-93669ec3-6e96-4a75-a6ad-ee2c3e80d6d9 tempest-GroupSnapshotsV319Test-37185426 None] Delete group completed successfully. Jul 01 04:01:08 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=59,cinder:UPDATE=49,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:01:08 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-b180673f-604a-40ce-8878-8797a377df6b req-a71a62ee-62b0-41fc-bf6e-a672c2eb14bb tempest-AttachVolumeTestJSON-133197759 None] Terminate volume connection completed successfully. Jul 01 04:01:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-b180673f-604a-40ce-8878-8797a377df6b req-a71a62ee-62b0-41fc-bf6e-a672c2eb14bb tempest-AttachVolumeTestJSON-133197759 None] Deleting attachment 32ce6f19-ebf3-4e0d-aeff-3db6ad4d8fa4. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:01:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Acquiring lock "cinder-eacb4da4-60db-4bda-8938-06ee73544e1d-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:01:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Lock "cinder-eacb4da4-60db-4bda-8938-06ee73544e1d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:01:11 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=47,cinder:UPDATE=49,cinder:DELETE=4,cinder:INSERT=13 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:01:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Acquiring lock "cinder-quobyte-eacb4da4-60db-4bda-8938-06ee73544e1d" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:01:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Lock "cinder-quobyte-eacb4da4-60db-4bda-8938-06ee73544e1d" acquired by "delete_volume" :: waited 0.036s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:01:11 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bf6d36-1e4d-423a-812a-f31e547b0e52]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:01:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eacb4da4-60db-4bda-8938-06ee73544e1d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:11 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eacb4da4-60db-4bda-8938-06ee73544e1d Jul 01 04:01:11 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:12 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eacb4da4-60db-4bda-8938-06ee73544e1d" returned: 0 in 1.326s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eacb4da4-60db-4bda-8938-06ee73544e1d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:12 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eacb4da4-60db-4bda-8938-06ee73544e1d Jul 01 04:01:12 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:13 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eacb4da4-60db-4bda-8938-06ee73544e1d" returned: 0 in 0.982s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Lock "cinder-quobyte-eacb4da4-60db-4bda-8938-06ee73544e1d" released by "delete_volume" :: held 2.373s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:01:13 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Created reservations ['43314b21-d42e-415d-9394-66e328e48f87', '280618b3-1247-4d29-8d87-ac08c3fac10c', 'd7fa264e-70de-4e93-a596-089c54d2ff3e', '41d3a75f-cdcc-4d4d-ad76-d3fd1cbd548b'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:01:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:01:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:01:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:01:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:01:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:01:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:13 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:01:13 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:14 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.829s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:14 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:01:14 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Deleted volume successfully. Jul 01 04:01:14 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-755f62a5-3054-4351-ac4e-e427c168c896 tempest-TaggedAttachmentsTest-1774711315 None] Lock "cinder-eacb4da4-60db-4bda-8938-06ee73544e1d-delete_volume" released by "delete_volume" :: held 3.511s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Flow 'volume_create_manager' (3ee09478-3c27-4610-97b5-e581981946cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f495682-0a85-4367-99a6-985a95c86214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f495682-0a85-4367-99a6-985a95c86214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1581489614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333ad9bd-120c-4ad0-8dfa-0b916f35dbde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cfcb3f88cce4446afdce79fa73e9bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:01:18Z,use_quota=True,user_id='762c0521301a45ba985ef428706235ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c166b6fe-ec86-4b75-a090-143ce67adf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c166b6fe-ec86-4b75-a090-143ce67adf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e496efe-6cb7-4138-b27a-58282cc6f8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e496efe-6cb7-4138-b27a-58282cc6f8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '333ad9bd-120c-4ad0-8dfa-0b916f35dbde', 'volume_name': 'volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab13a44-7cbe-4d14-8c9d-6f5042697a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab13a44-7cbe-4d14-8c9d-6f5042697a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6cd1df-708c-428d-b6bb-3b091c35486c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:17 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Volume 333ad9bd-120c-4ad0-8dfa-0b916f35dbde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde', 'volume_size': 1} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1581489614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333ad9bd-120c-4ad0-8dfa-0b916f35dbde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cfcb3f88cce4446afdce79fa73e9bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:01:18Z,use_quota=True,user_id='762c0521301a45ba985ef428706235ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Creating volume 333ad9bd-120c-4ad0-8dfa-0b916f35dbde {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:01:17 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:01:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:18 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde 1073741824 Jul 01 04:01:18 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:18 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde 1073741824" returned: 0 in 0.918s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:18 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde Jul 01 04:01:18 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:19 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde" returned: 0 in 0.722s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:01:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:01:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6cd1df-708c-428d-b6bb-3b091c35486c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecf0bfc-52c8-4d12-83ac-f36d10988209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:19 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Volume volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde (333ad9bd-120c-4ad0-8dfa-0b916f35dbde): created successfully Jul 01 04:01:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecf0bfc-52c8-4d12-83ac-f36d10988209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Flow 'volume_create_manager' (3ee09478-3c27-4610-97b5-e581981946cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:01:19 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d6126274-711d-488a-a5df-19dd6436a0b2 tempest-VolumesServicesTestJSON-46318817 None] Created volume successfully. Jul 01 04:01:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Acquiring lock "cinder-333ad9bd-120c-4ad0-8dfa-0b916f35dbde-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:01:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Lock "cinder-333ad9bd-120c-4ad0-8dfa-0b916f35dbde-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:01:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Acquiring lock "cinder-quobyte-333ad9bd-120c-4ad0-8dfa-0b916f35dbde" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:01:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Lock "cinder-quobyte-333ad9bd-120c-4ad0-8dfa-0b916f35dbde" acquired by "delete_volume" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:01:20 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6467387f-829a-4a21-a1b7-95c0b4d2a089]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:01:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:20 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde Jul 01 04:01:20 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:21 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde" returned: 0 in 1.040s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:21 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde Jul 01 04:01:21 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:22 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-333ad9bd-120c-4ad0-8dfa-0b916f35dbde" returned: 0 in 1.185s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:22 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Lock "cinder-quobyte-333ad9bd-120c-4ad0-8dfa-0b916f35dbde" released by "delete_volume" :: held 2.277s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:01:22 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Created reservations ['405ef348-3157-4222-92f2-fd34b5a5f50f', '4abe730c-4412-4ca8-b078-470d885b0d39', 'b0425090-8a16-4523-86a6-9f7c9ac1262b', '804534af-a677-43e4-8a39-9512ea5afb46'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:01:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:01:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:01:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:01:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:01:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:01:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:22 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:01:22 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:23 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.006s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:23 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:01:23 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Deleted volume successfully. Jul 01 04:01:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c1b74809-69ad-4942-92d9-f38938caa926 tempest-VolumesServicesTestJSON-46318817 None] Lock "cinder-333ad9bd-120c-4ad0-8dfa-0b916f35dbde-delete_volume" released by "delete_volume" :: held 3.615s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:01:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:01:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:01:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:01:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:01:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:01:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:01:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:24 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:01:24 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:26 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.859s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:26 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:01:26 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:01:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 8 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:01:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:01:32 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=10,cinder:INSERT=5,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:01:33 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Flow 'volume_create_manager' (37cf235c-8a1e-4813-b975-3e4069ac9717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730650ee-10e5-4cbc-9fe4-574e278ded07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730650ee-10e5-4cbc-9fe4-574e278ded07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1011917711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f04a84c-e138-466c-a065-a09a7d196a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6749faaa5c147208ce32a1d7ebae4ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:01:49Z,use_quota=True,user_id='c2b4caafc6b6492ab0593922b213f177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf5bb70-bb4d-4f37-9898-d7e707629d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf5bb70-bb4d-4f37-9898-d7e707629d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d431e8f-d022-4aad-8297-68b5905c0f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d431e8f-d022-4aad-8297-68b5905c0f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f04a84c-e138-466c-a065-a09a7d196a94', 'volume_name': 'volume-8f04a84c-e138-466c-a065-a09a7d196a94', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c6d454-6877-4cdf-8cca-088157101d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c6d454-6877-4cdf-8cca-088157101d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc93b63c-342a-4f60-81b7-987d7a2b840d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:49 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Volume 8f04a84c-e138-466c-a065-a09a7d196a94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f04a84c-e138-466c-a065-a09a7d196a94', 'volume_size': 1} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1011917711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f04a84c-e138-466c-a065-a09a7d196a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6749faaa5c147208ce32a1d7ebae4ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:01:49Z,use_quota=True,user_id='c2b4caafc6b6492ab0593922b213f177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Creating volume 8f04a84c-e138-466c-a065-a09a7d196a94 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:01:49 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:01:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8f04a84c-e138-466c-a065-a09a7d196a94 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:49 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8f04a84c-e138-466c-a065-a09a7d196a94 1073741824 Jul 01 04:01:49 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:50 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:01:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Flow 'volume_create_manager' (2249ccc6-c7d3-40d1-bb43-2b68d877887e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:01:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83e1171-89fc-4798-be25-6b65fd58690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83e1171-89fc-4798-be25-6b65fd58690c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1659994864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb95c8a-81f2-43a1-a21f-dd9867dfd566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88e83f27f9848d1926e1ca7fe921eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:01:50Z,use_quota=True,user_id='57ab7a7fcfc2449cb3da08742e18af36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cedafd6-b765-4246-81b4-748bd799ed54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cedafd6-b765-4246-81b4-748bd799ed54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc3b2a1-1542-424a-be6d-9361a6dc526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:50 devstack cinder-volume[86177]: DEBUG cinder.image.glance [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Creating Keystone auth plugin from conf {{(pid=86177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 04:01:50 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8f04a84c-e138-466c-a065-a09a7d196a94 1073741824" returned: 0 in 1.337s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8f04a84c-e138-466c-a065-a09a7d196a94 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:51 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8f04a84c-e138-466c-a065-a09a7d196a94 Jul 01 04:01:51 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc3b2a1-1542-424a-be6d-9361a6dc526c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dfb95c8a-81f2-43a1-a21f-dd9867dfd566', 'volume_name': 'volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566', 'volume_size': 1, 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43baa4017014b09a384294975690a79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'created_at': datetime.datetime(2026, 7, 1, 1, 52, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 1, 52, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc2424d-1ed1-44eb-b5c8-1704044d47b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc2424d-1ed1-44eb-b5c8-1704044d47b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f375b229-b459-41f2-879c-f43e44553e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:51 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Volume dfb95c8a-81f2-43a1-a21f-dd9867dfd566: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566', 'volume_size': 1, 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43baa4017014b09a384294975690a79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'created_at': datetime.datetime(2026, 7, 1, 1, 52, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 1, 52, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 01 04:01:51 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Trying to clone dfb95c8a-81f2-43a1-a21f-dd9867dfd566 from image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 at location (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]). {{(pid=86177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 04:01:52 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ute_xq2fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 04:01:52 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Image download 20.69 MB at 20.69 MB/s Jul 01 04:01:52 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74fcb44-6705-4d4c-9ec2-3bff8f97f88d]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:01:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ute_xq2fdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:52 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8f04a84c-e138-466c-a065-a09a7d196a94" returned: 0 in 1.394s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] <== create_volume: return (2799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:01:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.810s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:01:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc93b63c-342a-4f60-81b7-987d7a2b840d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f04a84c-e138-466c-a065-a09a7d196a94', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16af284-43e5-48e1-809f-6a3c13064f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:01:52 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Volume volume-8f04a84c-e138-466c-a065-a09a7d196a94 (8f04a84c-e138-466c-a065-a09a7d196a94): created successfully Jul 01 04:01:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16af284-43e5-48e1-809f-6a3c13064f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:01:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Flow 'volume_create_manager' (37cf235c-8a1e-4813-b975-3e4069ac9717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:01:52 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ute_xq2fdevstack@QuobyteHD Jul 01 04:01:52 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:52 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-691a2fac-23d6-4439-baba-ad77b3963fa7 tempest-AttachVolumeShelveTestJSON-539019461 None] Created volume successfully. Jul 01 04:01:53 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ute_xq2fdevstack@QuobyteHD" returned: 0 in 1.313s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:53 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Temporary image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 is fetched for user 57ab7a7fcfc2449cb3da08742e18af36. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 04:01:53 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[714bb5f3-c094-42aa-ba11-43c8f6314110]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:01:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ute_xq2fdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:54 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ute_xq2fdevstack@QuobyteHD Jul 01 04:01:54 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:54 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ute_xq2fdevstack@QuobyteHD" returned: 0 in 1.239s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:01:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:01:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1659994864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb95c8a-81f2-43a1-a21f-dd9867dfd566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88e83f27f9848d1926e1ca7fe921eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:01:50Z,use_quota=True,user_id='57ab7a7fcfc2449cb3da08742e18af36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:01:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Creating volume dfb95c8a-81f2-43a1-a21f-dd9867dfd566 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:01:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:01:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:01:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:01:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:01:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:01:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:01:55 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:01:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:55 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 1073741824 Jul 01 04:01:55 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:56 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 1073741824" returned: 0 in 1.123s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:56 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 Jul 01 04:01:56 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:57 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566" returned: 0 in 1.067s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:57 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] <== create_volume: return (2253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:01:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.294s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:01:57 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Attempting download of 44c37c3e-a2cd-450f-a8e6-b9270ee06395 ((None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}])) to volume dfb95c8a-81f2-43a1-a21f-dd9867dfd566. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 04:01:57 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b901b78a-8c68-4900-9fb1-1b758d7dfde1]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:01:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_7vuphugp {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:57 devstack sudo[91725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_7vuphugp Jul 01 04:01:57 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:58 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_7vuphugp" returned: 0 in 0.808s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_7vuphugp {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:58 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_7vuphugp Jul 01 04:01:58 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:59 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_7vuphugp" returned: 1 in 0.807s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_7vuphugp' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:01:59 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd69599-6dda-429d-bced-c5d42025c897]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:01:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ute_xq2fdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:59 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ute_xq2fdevstack@QuobyteHD Jul 01 04:01:59 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:01:59 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Jul 01 04:01:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ute_xq2fdevstack@QuobyteHD" returned: 0 in 0.931s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:01:59 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] 44c37c3e-a2cd-450f-a8e6-b9270ee06395 was qcow2, converting to raw {{(pid=86177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 04:01:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ute_xq2fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:01:59 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ute_xq2fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 Jul 01 04:01:59 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:04 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ute_xq2fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566" returned: 0 in 4.861s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:04 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ute_xq2fdevstack@QuobyteHD, size 112.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:02:04 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Converted 112.00 MB image at 23.03 MB/s Jul 01 04:02:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:04 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 1G Jul 01 04:02:04 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:06 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 1G" returned: 0 in 1.807s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:06 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc32ac3b-a2a0-40b8-9ab1-15af24192860]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:02:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:06 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 Jul 01 04:02:06 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:07 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=5,cinder:SELECT=7,cinder:INSERT=2 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:02:07 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=3,cinder:UPDATE=6,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:02:07 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566" returned: 0 in 1.229s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:08 devstack sudo[91975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 Jul 01 04:02:08 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:09 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566" returned: 1 in 1.706s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:02:09 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Downloaded image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 ((None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}])) to volume dfb95c8a-81f2-43a1-a21f-dd9867dfd566 successfully. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 04:02:09 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Temporary image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 for user 57ab7a7fcfc2449cb3da08742e18af36 is deleted. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 04:02:09 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Marking volume dfb95c8a-81f2-43a1-a21f-dd9867dfd566 as bootable. {{(pid=86177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 04:02:09 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Copying metadata from image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 to dfb95c8a-81f2-43a1-a21f-dd9867dfd566. {{(pid=86177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 04:02:09 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Creating volume glance metadata for volume dfb95c8a-81f2-43a1-a21f-dd9867dfd566 backed by image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 04:02:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f375b229-b459-41f2-879c-f43e44553e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566', 'volume_size': 1, 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43baa4017014b09a384294975690a79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'created_at': datetime.datetime(2026, 7, 1, 1, 52, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 1, 52, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff50e6e-a077-4ede-89ec-90cea2030b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:10 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Volume volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 (dfb95c8a-81f2-43a1-a21f-dd9867dfd566): created successfully Jul 01 04:02:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff50e6e-a077-4ede-89ec-90cea2030b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Flow 'volume_create_manager' (2249ccc6-c7d3-40d1-bb43-2b68d877887e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:02:10 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-20e26851-69b9-4ca1-9e8d-5dea57038556 tempest-VolumesImageMetadata-817251744 None] Created volume successfully. Jul 01 04:02:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Acquiring lock "cinder-dfb95c8a-81f2-43a1-a21f-dd9867dfd566-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:02:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Lock "cinder-dfb95c8a-81f2-43a1-a21f-dd9867dfd566-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:02:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Acquiring lock "cinder-quobyte-dfb95c8a-81f2-43a1-a21f-dd9867dfd566" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:02:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Lock "cinder-quobyte-dfb95c8a-81f2-43a1-a21f-dd9867dfd566" acquired by "delete_volume" :: waited 0.021s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:02:11 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[80db4edb-5c3a-40c6-955e-44f63f4d6481]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:02:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:11 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 Jul 01 04:02:11 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:13 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566" returned: 0 in 1.730s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:13 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 Jul 01 04:02:13 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:14 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566" returned: 1 in 1.196s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:02:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:14 devstack sudo[92045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566 Jul 01 04:02:14 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:15 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dfb95c8a-81f2-43a1-a21f-dd9867dfd566" returned: 0 in 1.100s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:15 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Lock "cinder-quobyte-dfb95c8a-81f2-43a1-a21f-dd9867dfd566" released by "delete_volume" :: held 4.236s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:02:15 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Created reservations ['1e41d14d-d037-47a9-862a-6451c5114bd8', '70384ab2-b2b7-4403-9d55-7271ee2bcb0b', '3830d956-7cff-47dc-acd3-1085f688c1c1', '120e956a-1c40-457c-ba27-042a291a2e76'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:02:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:02:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:02:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:02:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:02:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:02:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:16 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:02:16 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-ff514fe3-512a-4346-a159-4e1cccd6498c req-84772a65-5bcc-49e9-98d7-6696909b14f8 tempest-AttachVolumeShelveTestJSON-539019461 None] No connector for attachment a81fc8f4-d548-4c8a-9639-255662ead654; skipping storage backend terminate_connection call. {{(pid=86177) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 01 04:02:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-ff514fe3-512a-4346-a159-4e1cccd6498c req-84772a65-5bcc-49e9-98d7-6696909b14f8 tempest-AttachVolumeShelveTestJSON-539019461 None] Deleting attachment a81fc8f4-d548-4c8a-9639-255662ead654. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:02:17 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.013s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:17 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:02:17 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Deleted volume successfully. Jul 01 04:02:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f011ea9c-786c-4559-9def-4fdb91e62827 tempest-VolumesImageMetadata-817251744 None] Lock "cinder-dfb95c8a-81f2-43a1-a21f-dd9867dfd566-delete_volume" released by "delete_volume" :: held 5.636s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Flow 'volume_create_manager' (fa19a339-aed9-4e43-9456-49c83b0f9553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9173a6e8-3c90-47d1-977e-37da343ae8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9173a6e8-3c90-47d1-977e-37da343ae8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2072334165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f676e7cc-1ff4-4712-9aea-df843208cf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae9982f6fa14c56a7fa4ccc792a0209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:02:21Z,use_quota=True,user_id='a7bfd7463c72425c85b27d90aa01f09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee33cafe-ecec-45a1-ae97-da1ec8276807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee33cafe-ecec-45a1-ae97-da1ec8276807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198a2cfe-4ff6-4c83-9d66-b634443f42c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198a2cfe-4ff6-4c83-9d66-b634443f42c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f676e7cc-1ff4-4712-9aea-df843208cf1c', 'volume_name': 'volume-f676e7cc-1ff4-4712-9aea-df843208cf1c', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1615c7ab-a33a-4022-9739-6fc2c9916b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1615c7ab-a33a-4022-9739-6fc2c9916b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b869d584-cf83-44ce-b55a-a5693e17f29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:20 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Volume f676e7cc-1ff4-4712-9aea-df843208cf1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f676e7cc-1ff4-4712-9aea-df843208cf1c', 'volume_size': 1} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2072334165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f676e7cc-1ff4-4712-9aea-df843208cf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae9982f6fa14c56a7fa4ccc792a0209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:02:21Z,use_quota=True,user_id='a7bfd7463c72425c85b27d90aa01f09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Creating volume f676e7cc-1ff4-4712-9aea-df843208cf1c {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:02:20 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:02:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:20 devstack sudo[92159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c 1073741824 Jul 01 04:02:21 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:22 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:02:22 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Flow 'volume_create_manager' (9d563cc8-d4d7-498d-bb9e-eed17823f2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:02:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73100aab-0ee1-4477-91af-4441f9733558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c 1073741824" returned: 0 in 1.292s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73100aab-0ee1-4477-91af-4441f9733558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-927839015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db8d582-064c-4239-9cd0-8886b6a70944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b74dba5f724cc484fa397f5d2b2880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:02:22Z,use_quota=True,user_id='e9cb85c777c24efb8b86ccc1fba905de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d362f20-d04a-47b1-8ba1-6cab66906dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d362f20-d04a-47b1-8ba1-6cab66906dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a2f6a8-3af7-4bc6-be03-ad27e8d9c0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a2f6a8-3af7-4bc6-be03-ad27e8d9c0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db8d582-064c-4239-9cd0-8886b6a70944', 'volume_name': 'volume-5db8d582-064c-4239-9cd0-8886b6a70944', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72f21f9-8d28-4877-b1f6-41ccbab127ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72f21f9-8d28-4877-b1f6-41ccbab127ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb0a3c5-2c4b-4471-a0d9-241356716efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:22 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Volume 5db8d582-064c-4239-9cd0-8886b6a70944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db8d582-064c-4239-9cd0-8886b6a70944', 'volume_size': 1} Jul 01 04:02:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:02:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:22 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c Jul 01 04:02:22 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:23 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c" returned: 0 in 0.768s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] <== create_volume: return (2264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.267s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.790s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-927839015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db8d582-064c-4239-9cd0-8886b6a70944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b74dba5f724cc484fa397f5d2b2880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:02:22Z,use_quota=True,user_id='e9cb85c777c24efb8b86ccc1fba905de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Creating volume 5db8d582-064c-4239-9cd0-8886b6a70944 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:02:23 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5db8d582-064c-4239-9cd0-8886b6a70944 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:23 devstack sudo[92173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5db8d582-064c-4239-9cd0-8886b6a70944 1073741824 Jul 01 04:02:23 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b869d584-cf83-44ce-b55a-a5693e17f29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f676e7cc-1ff4-4712-9aea-df843208cf1c', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b276783-7974-46df-9240-39cf95eeb6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:23 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Volume volume-f676e7cc-1ff4-4712-9aea-df843208cf1c (f676e7cc-1ff4-4712-9aea-df843208cf1c): created successfully Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b276783-7974-46df-9240-39cf95eeb6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Flow 'volume_create_manager' (fa19a339-aed9-4e43-9456-49c83b0f9553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:02:23 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-fcf1c2b7-7d28-4f4b-8594-29b874b531ff tempest-SnapshotMetadataTestJSON-595175715 None] Created volume successfully. Jul 01 04:02:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:02:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:02:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:02:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:02:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:02:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:02:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:24 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:02:24 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:02:25 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5db8d582-064c-4239-9cd0-8886b6a70944 1073741824" returned: 0 in 2.331s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5db8d582-064c-4239-9cd0-8886b6a70944 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:25 devstack sudo[92246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5db8d582-064c-4239-9cd0-8886b6a70944 Jul 01 04:02:25 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:26 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.496s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:26 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:02:26 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5db8d582-064c-4239-9cd0-8886b6a70944" returned: 0 in 1.184s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] <== create_volume: return (3699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:02:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.702s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:02:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.832s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:02:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb0a3c5-2c4b-4471-a0d9-241356716efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db8d582-064c-4239-9cd0-8886b6a70944', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585e09c0-b352-4779-82c6-8747b7602b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] Creating offline snapshot 5c73e0fd-c5c4-4690-aad6-0d2e1226f373 of volume f676e7cc-1ff4-4712-9aea-df843208cf1c {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:02:26 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Volume volume-5db8d582-064c-4239-9cd0-8886b6a70944 (5db8d582-064c-4239-9cd0-8886b6a70944): created successfully Jul 01 04:02:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585e09c0-b352-4779-82c6-8747b7602b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Flow 'volume_create_manager' (9d563cc8-d4d7-498d-bb9e-eed17823f2ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:02:27 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63d76df-8f91-4c30-a768-c4f58a683488]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:02:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:27 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-2fdfec85-3c3a-4603-8dec-420970109934 tempest-ServerRescueNegativeTestJSON-26614179 None] Created volume successfully. Jul 01 04:02:27 devstack sudo[92253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c Jul 01 04:02:27 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:28 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c" returned: 0 in 1.943s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:29 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373 1G Jul 01 04:02:29 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:30 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373 1G" returned: 0 in 1.977s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f676e7cc-1ff4-4712-9aea-df843208cf1c -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:31 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f676e7cc-1ff4-4712-9aea-df843208cf1c -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373 Jul 01 04:02:31 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:32 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f676e7cc-1ff4-4712-9aea-df843208cf1c -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373" returned: 0 in 1.088s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:32 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373 is being set with open permissions: ugo+rw Jul 01 04:02:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:32 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373 Jul 01 04:02:32 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:34 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373" returned: 0 in 2.818s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:35 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.info Jul 01 04:02:35 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:36 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.info" returned: 0 in 1.206s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:36 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.info is being set with open permissions: ugo+rw Jul 01 04:02:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:36 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.info Jul 01 04:02:36 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:36 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.info" returned: 0 in 0.711s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 10.037s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:02:37 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-85186188-56f9-4d5b-a60f-d93e734e8e3b tempest-SnapshotMetadataTestJSON-595175715 None] Create snapshot completed successfully Jul 01 04:02:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Acquiring lock "cinder-5c73e0fd-c5c4-4690-aad6-0d2e1226f373-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:02:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Lock "cinder-5c73e0fd-c5c4-4690-aad6-0d2e1226f373-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:02:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Acquiring lock "cinder-quobyte-f676e7cc-1ff4-4712-9aea-df843208cf1c" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:02:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Lock "cinder-quobyte-f676e7cc-1ff4-4712-9aea-df843208cf1c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:02:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Acquiring lock "cinder-quobyte-5c73e0fd-c5c4-4690-aad6-0d2e1226f373" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:02:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Lock "cinder-quobyte-5c73e0fd-c5c4-4690-aad6-0d2e1226f373" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:02:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Deleting offline snapshot 5c73e0fd-c5c4-4690-aad6-0d2e1226f373 of volume f676e7cc-1ff4-4712-9aea-df843208cf1c {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:02:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] snapshot_file for this snap is: volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:02:39 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f568c5-101a-4838-b980-ad787e408e72]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:02:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:39 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373 Jul 01 04:02:39 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:40 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373" returned: 0 in 1.642s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f676e7cc-1ff4-4712-9aea-df843208cf1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:02:40 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3802864b-537c-4a16-bf19-3cbea5b579d2]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:02:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:40 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c Jul 01 04:02:40 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:41 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c" returned: 0 in 0.864s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:41 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373 Jul 01 04:02:41 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:42 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373" returned: 0 in 0.956s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:42 devstack sudo[92469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373 Jul 01 04:02:42 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:43 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c.5c73e0fd-c5c4-4690-aad6-0d2e1226f373" returned: 0 in 1.238s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Lock "cinder-quobyte-5c73e0fd-c5c4-4690-aad6-0d2e1226f373" released by "_delete_snapshot" :: held 4.940s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:02:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Lock "cinder-quobyte-f676e7cc-1ff4-4712-9aea-df843208cf1c" released by "delete_snapshot" :: held 4.988s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:02:44 devstack cinder-volume[86177]: WARNING cinder.quota [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:02:44 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Created reservations ['48e47e7e-99ea-4999-8465-f08b9cc1e848', 'cc802812-7887-4290-a8ad-4b2c540adb1e', '1784d77c-2a37-40c6-b1b3-b1c2c23652df', 'a3e5e0aa-9aea-4d81-acbe-9b7f64b3c00a'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:02:44 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Delete snapshot completed successfully. Jul 01 04:02:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2b8641e6-caf8-497a-8640-1fdcf3721372 tempest-SnapshotMetadataTestJSON-595175715 None] Lock "cinder-5c73e0fd-c5c4-4690-aad6-0d2e1226f373-delete_snapshot" released by "delete_snapshot" :: held 5.548s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:02:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Acquiring lock "cinder-f676e7cc-1ff4-4712-9aea-df843208cf1c-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:02:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Lock "cinder-f676e7cc-1ff4-4712-9aea-df843208cf1c-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:02:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Acquiring lock "cinder-quobyte-f676e7cc-1ff4-4712-9aea-df843208cf1c" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:02:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Lock "cinder-quobyte-f676e7cc-1ff4-4712-9aea-df843208cf1c" acquired by "delete_volume" :: waited 0.045s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:02:46 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1f2ffc-45b5-41e8-b3f4-303e77344d1e]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:02:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:46 devstack sudo[92539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c Jul 01 04:02:46 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:48 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c" returned: 0 in 1.923s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:48 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c Jul 01 04:02:48 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:49 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f676e7cc-1ff4-4712-9aea-df843208cf1c" returned: 0 in 1.513s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:49 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Lock "cinder-quobyte-f676e7cc-1ff4-4712-9aea-df843208cf1c" released by "delete_volume" :: held 3.617s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:02:49 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Created reservations ['6b8e40ea-efcb-4ba3-8fcc-3650eb5eb47d', '0e4b318c-4fbf-4405-a71b-16d1c23abf87', '5e222831-5a48-41f2-ae78-914b0770c45d', 'ba92070f-c6dc-428b-8a1d-40b1e956e7ed'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:02:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:02:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:02:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:02:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:02:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:02:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:49 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:02:49 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Acquiring lock "cinder-5db8d582-064c-4239-9cd0-8886b6a70944-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:02:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Lock "cinder-5db8d582-064c-4239-9cd0-8886b6a70944-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:02:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Acquiring lock "cinder-quobyte-5db8d582-064c-4239-9cd0-8886b6a70944" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:02:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Lock "cinder-quobyte-5db8d582-064c-4239-9cd0-8886b6a70944" acquired by "delete_volume" :: waited 0.036s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:02:50 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b260cf-6ce1-4164-a89f-c2c16aef68e0]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:02:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5db8d582-064c-4239-9cd0-8886b6a70944 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:50 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5db8d582-064c-4239-9cd0-8886b6a70944 Jul 01 04:02:50 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:51 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.355s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:51 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:02:51 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Deleted volume successfully. Jul 01 04:02:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-246a1975-fbd5-41fb-af39-40190b4026f5 tempest-SnapshotMetadataTestJSON-595175715 None] Lock "cinder-f676e7cc-1ff4-4712-9aea-df843208cf1c-delete_volume" released by "delete_volume" :: held 5.427s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:02:51 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5db8d582-064c-4239-9cd0-8886b6a70944" returned: 0 in 1.517s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5db8d582-064c-4239-9cd0-8886b6a70944 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:51 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5db8d582-064c-4239-9cd0-8886b6a70944 Jul 01 04:02:51 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:51 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:02:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Flow 'volume_create_manager' (4bb22e7b-5a77-4c82-97b1-ebf201ef9668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:02:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8acbd163-e44f-468b-8f8c-8e76f67fc341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8acbd163-e44f-468b-8f8c-8e76f67fc341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1688884964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61198bd-abb4-4dfa-8357-495ea433e549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2c68bbc8fa414aa9365dbdc4d91c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:02:52Z,use_quota=True,user_id='bed84f432ac84999b4f35bd3731459d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5923e5-3ef4-4b0c-8337-b5f051f2ba61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5923e5-3ef4-4b0c-8337-b5f051f2ba61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412d302a-c54c-422c-95e7-41141a22ace6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412d302a-c54c-422c-95e7-41141a22ace6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c61198bd-abb4-4dfa-8357-495ea433e549', 'volume_name': 'volume-c61198bd-abb4-4dfa-8357-495ea433e549', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3c6a48-ecf8-4645-bd26-4f1778384919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3c6a48-ecf8-4645-bd26-4f1778384919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574f7c55-780b-42fe-b646-a253ce51cfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:52 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Volume c61198bd-abb4-4dfa-8357-495ea433e549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c61198bd-abb4-4dfa-8357-495ea433e549', 'volume_size': 1} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1688884964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61198bd-abb4-4dfa-8357-495ea433e549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2c68bbc8fa414aa9365dbdc4d91c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:02:52Z,use_quota=True,user_id='bed84f432ac84999b4f35bd3731459d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Creating volume c61198bd-abb4-4dfa-8357-495ea433e549 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:02:52 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:02:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c61198bd-abb4-4dfa-8357-495ea433e549 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:52 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c61198bd-abb4-4dfa-8357-495ea433e549 1073741824 Jul 01 04:02:52 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:53 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5db8d582-064c-4239-9cd0-8886b6a70944" returned: 0 in 1.176s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Lock "cinder-quobyte-5db8d582-064c-4239-9cd0-8886b6a70944" released by "delete_volume" :: held 2.783s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:02:53 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Created reservations ['965c3265-5211-4bb8-b3ea-d5b65548a2e5', '27458a8e-76b7-4cf7-8cd7-4355c5109a26', 'a30d9060-f69c-4e49-9cc0-76653de6de9b', '60f6bf73-acc3-4367-84ef-6c008502e90f'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:02:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:02:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:02:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:02:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:02:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:02:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:53 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:02:53 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:53 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c61198bd-abb4-4dfa-8357-495ea433e549 1073741824" returned: 0 in 1.603s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c61198bd-abb4-4dfa-8357-495ea433e549 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:53 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c61198bd-abb4-4dfa-8357-495ea433e549 Jul 01 04:02:53 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:02:54 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.606s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:54 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:02:54 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Deleted volume successfully. Jul 01 04:02:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a304474d-9e61-48c4-b0ec-4804c24c4cc1 tempest-ServerRescueNegativeTestJSON-26614179 None] Lock "cinder-5db8d582-064c-4239-9cd0-8886b6a70944-delete_volume" released by "delete_volume" :: held 4.841s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:02:55 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Jul 01 04:02:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c61198bd-abb4-4dfa-8357-495ea433e549" returned: 0 in 1.262s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:02:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] <== create_volume: return (3001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:02:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:02:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574f7c55-780b-42fe-b646-a253ce51cfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c61198bd-abb4-4dfa-8357-495ea433e549', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3901e171-c722-4b31-a5dc-936b4cfc1441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:02:55 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Volume volume-c61198bd-abb4-4dfa-8357-495ea433e549 (c61198bd-abb4-4dfa-8357-495ea433e549): created successfully Jul 01 04:02:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3901e171-c722-4b31-a5dc-936b4cfc1441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:02:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Flow 'volume_create_manager' (4bb22e7b-5a77-4c82-97b1-ebf201ef9668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:02:55 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d2506611-399d-4b2a-8ee2-68bfccbcf0c4 tempest-AttachVolumeTestJSON-133197759 None] Created volume successfully. Jul 01 04:02:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-ac96553a-fd64-4944-aded-b68a9b4258ba req-b075b4ee-98bb-4968-9826-34714b8ea1f1 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:02:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-ac96553a-fd64-4944-aded-b68a9b4258ba req-b075b4ee-98bb-4968-9826-34714b8ea1f1 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:02:59 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d2161b-6e16-4e97-835c-d61d5cfe1aed]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:02:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-ac96553a-fd64-4944-aded-b68a9b4258ba req-b075b4ee-98bb-4968-9826-34714b8ea1f1 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c61198bd-abb4-4dfa-8357-495ea433e549 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:02:59 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c61198bd-abb4-4dfa-8357-495ea433e549 Jul 01 04:02:59 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:01 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-ac96553a-fd64-4944-aded-b68a9b4258ba req-b075b4ee-98bb-4968-9826-34714b8ea1f1 tempest-AttachVolumeTestJSON-133197759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c61198bd-abb4-4dfa-8357-495ea433e549" returned: 0 in 1.266s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-ac96553a-fd64-4944-aded-b68a9b4258ba req-b075b4ee-98bb-4968-9826-34714b8ea1f1 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.285s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:01 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-ac96553a-fd64-4944-aded-b68a9b4258ba req-b075b4ee-98bb-4968-9826-34714b8ea1f1 tempest-AttachVolumeTestJSON-133197759 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-c61198bd-abb4-4dfa-8357-495ea433e549', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed9f91b0-9312-48d5-b889-0666151e6a90', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:03:01 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-ac96553a-fd64-4944-aded-b68a9b4258ba req-b075b4ee-98bb-4968-9826-34714b8ea1f1 tempest-AttachVolumeTestJSON-133197759 None] attachment_update completed successfully. Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Flow 'volume_create_manager' (071f317b-ec9d-4b96-8c79-df4ff36e0768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f0c943-93d9-4024-88b1-3fbe61e9a94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f0c943-93d9-4024-88b1-3fbe61e9a94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1511709147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc9e186-d708-4914-94f3-eac0e98f3c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5332161b7740d4a668598a71122cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:02Z,use_quota=True,user_id='0a8f055c7d854be2a9b495a1daccb33b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b95a53-f645-4d6c-953e-3afe810ee41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b95a53-f645-4d6c-953e-3afe810ee41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06af975d-2c83-48b4-8c09-ecd176170158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06af975d-2c83-48b4-8c09-ecd176170158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc9e186-d708-4914-94f3-eac0e98f3c28', 'volume_name': 'volume-bdc9e186-d708-4914-94f3-eac0e98f3c28', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9572b6b7-59e0-4e74-9efb-c4ef31a7b234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9572b6b7-59e0-4e74-9efb-c4ef31a7b234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da19a07c-7c35-4a7e-8b07-3adda56c5cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:02 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Volume bdc9e186-d708-4914-94f3-eac0e98f3c28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc9e186-d708-4914-94f3-eac0e98f3c28', 'volume_size': 1} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1511709147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc9e186-d708-4914-94f3-eac0e98f3c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5332161b7740d4a668598a71122cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:02Z,use_quota=True,user_id='0a8f055c7d854be2a9b495a1daccb33b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Creating volume bdc9e186-d708-4914-94f3-eac0e98f3c28 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:03:02 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:03:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-bdc9e186-d708-4914-94f3-eac0e98f3c28 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:02 devstack sudo[93135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-bdc9e186-d708-4914-94f3-eac0e98f3c28 1073741824 Jul 01 04:03:02 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:03 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-bdc9e186-d708-4914-94f3-eac0e98f3c28 1073741824" returned: 0 in 1.560s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-bdc9e186-d708-4914-94f3-eac0e98f3c28 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:04 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-bdc9e186-d708-4914-94f3-eac0e98f3c28 Jul 01 04:03:04 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:04 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-bdc9e186-d708-4914-94f3-eac0e98f3c28" returned: 0 in 0.750s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:04 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] <== create_volume: return (2411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:03:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.417s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da19a07c-7c35-4a7e-8b07-3adda56c5cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc9e186-d708-4914-94f3-eac0e98f3c28', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782ba2a0-7d82-44e8-9744-9e3c2a761dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:04 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Volume volume-bdc9e186-d708-4914-94f3-eac0e98f3c28 (bdc9e186-d708-4914-94f3-eac0e98f3c28): created successfully Jul 01 04:03:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782ba2a0-7d82-44e8-9744-9e3c2a761dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Flow 'volume_create_manager' (071f317b-ec9d-4b96-8c79-df4ff36e0768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:04 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c5fa0857-d9f3-4ddb-a40c-4ce608221d23 tempest-AbsoluteLimitsTests-1960141310 None] Created volume successfully. Jul 01 04:03:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Acquiring lock "cinder-bdc9e186-d708-4914-94f3-eac0e98f3c28-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Lock "cinder-bdc9e186-d708-4914-94f3-eac0e98f3c28-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Acquiring lock "cinder-quobyte-bdc9e186-d708-4914-94f3-eac0e98f3c28" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Lock "cinder-quobyte-bdc9e186-d708-4914-94f3-eac0e98f3c28" acquired by "delete_volume" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:05 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf7f783-0086-4bfa-969c-a3d7472d5f77]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-bdc9e186-d708-4914-94f3-eac0e98f3c28 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:05 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-bdc9e186-d708-4914-94f3-eac0e98f3c28 Jul 01 04:03:05 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:06 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-bdc9e186-d708-4914-94f3-eac0e98f3c28" returned: 0 in 0.825s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-bdc9e186-d708-4914-94f3-eac0e98f3c28 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:06 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-bdc9e186-d708-4914-94f3-eac0e98f3c28 Jul 01 04:03:06 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Flow 'volume_create_manager' (43a68c53-3e63-49c7-b0a8-28c723f6b14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1257f941-8301-4da3-9832-fdc80400be0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1257f941-8301-4da3-9832-fdc80400be0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1068643612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61af572b-2f3a-48e9-8fb5-431ed6d36bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2c68bbc8fa414aa9365dbdc4d91c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:07Z,use_quota=True,user_id='bed84f432ac84999b4f35bd3731459d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538a946e-7c42-4414-bf94-e89470d0a612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538a946e-7c42-4414-bf94-e89470d0a612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9fcf835-34a5-4572-a698-9799450ce80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9fcf835-34a5-4572-a698-9799450ce80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61af572b-2f3a-48e9-8fb5-431ed6d36bce', 'volume_name': 'volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80dd5f30-75c3-4569-a231-e18ca991599d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80dd5f30-75c3-4569-a231-e18ca991599d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca1d87d-2f95-4949-906a-50fef4555d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:06 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Volume 61af572b-2f3a-48e9-8fb5-431ed6d36bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce', 'volume_size': 1} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1068643612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61af572b-2f3a-48e9-8fb5-431ed6d36bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2c68bbc8fa414aa9365dbdc4d91c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:07Z,use_quota=True,user_id='bed84f432ac84999b4f35bd3731459d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Creating volume 61af572b-2f3a-48e9-8fb5-431ed6d36bce {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:03:06 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:03:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:06 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce 1073741824 Jul 01 04:03:06 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:07 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-bdc9e186-d708-4914-94f3-eac0e98f3c28" returned: 0 in 0.710s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Lock "cinder-quobyte-bdc9e186-d708-4914-94f3-eac0e98f3c28" released by "delete_volume" :: held 1.584s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:07 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Created reservations ['56d384cd-c395-4b85-8815-25908533d190', 'e17ce4f2-1b14-485f-b261-49beb987b987', '9d310e24-e874-41c0-913c-66378a2690ec', 'b7ecb4d7-34f8-479e-bbbe-f2caeed76ae2'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:03:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:07 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:07 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:07 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:03:07 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:07 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce 1073741824" returned: 0 in 0.839s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:07 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=52,cinder:INSERT=23,cinder:UPDATE=60,cinder:DELETE=4 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:03:07 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=52,cinder:SELECT=52,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:03:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:07 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce Jul 01 04:03:07 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:08 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.749s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:08 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:03:08 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Deleted volume successfully. Jul 01 04:03:08 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-85c6e762-1e84-42ba-bc45-a510a870e213 tempest-AbsoluteLimitsTests-1960141310 None] Lock "cinder-bdc9e186-d708-4914-94f3-eac0e98f3c28-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:08 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce" returned: 0 in 0.690s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:03:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca1d87d-2f95-4949-906a-50fef4555d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaaa868-3805-4843-b1c2-d699bffa344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:08 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Volume volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce (61af572b-2f3a-48e9-8fb5-431ed6d36bce): created successfully Jul 01 04:03:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaaa868-3805-4843-b1c2-d699bffa344b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Flow 'volume_create_manager' (43a68c53-3e63-49c7-b0a8-28c723f6b14c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:08 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-111f1376-89a3-4e0a-8d43-126ae819446a tempest-AttachVolumeTestJSON-133197759 None] Created volume successfully. Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-8693fcc0-6465-42e5-af79-8064afef9a94 req-be1a8883-ce41-4fae-a516-0e3eabf84f08 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-8693fcc0-6465-42e5-af79-8064afef9a94 req-be1a8883-ce41-4fae-a516-0e3eabf84f08 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e35b821-edb7-4104-89c9-47b968f7eb2f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-8693fcc0-6465-42e5-af79-8064afef9a94 req-be1a8883-ce41-4fae-a516-0e3eabf84f08 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:12 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce Jul 01 04:03:12 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Flow 'volume_create_manager' (3a5f5648-d277-430b-bd3c-f68b43726c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d3caf1-43d5-4f33-a1bd-f8edd0bfb748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d3caf1-43d5-4f33-a1bd-f8edd0bfb748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-944518024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02820b33-c63a-4d85-bfc2-51660c6edd06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c422fe278a148b6a2d9b3ed9eb7bad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:13Z,use_quota=True,user_id='eed600f81d9a4e2baf3748bb6cca69be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851ec23e-fb00-46fc-8513-4332ab14ddf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851ec23e-fb00-46fc-8513-4332ab14ddf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6afa044-e481-4c71-98f9-14e6ee1fe22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6afa044-e481-4c71-98f9-14e6ee1fe22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02820b33-c63a-4d85-bfc2-51660c6edd06', 'volume_name': 'volume-02820b33-c63a-4d85-bfc2-51660c6edd06', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f810f877-8ee6-4f8b-a33f-04afe09cc03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f810f877-8ee6-4f8b-a33f-04afe09cc03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f665fc6-caf4-4246-b422-9cebbc4ef8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:12 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Volume 02820b33-c63a-4d85-bfc2-51660c6edd06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02820b33-c63a-4d85-bfc2-51660c6edd06', 'volume_size': 1} Jul 01 04:03:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:13 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-8693fcc0-6465-42e5-af79-8064afef9a94 req-be1a8883-ce41-4fae-a516-0e3eabf84f08 tempest-AttachVolumeTestJSON-133197759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce" returned: 0 in 1.153s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-8693fcc0-6465-42e5-af79-8064afef9a94 req-be1a8883-ce41-4fae-a516-0e3eabf84f08 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.216s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.485s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-944518024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02820b33-c63a-4d85-bfc2-51660c6edd06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c422fe278a148b6a2d9b3ed9eb7bad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:13Z,use_quota=True,user_id='eed600f81d9a4e2baf3748bb6cca69be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:03:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Creating volume 02820b33-c63a-4d85-bfc2-51660c6edd06 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:03:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:03:13 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:03:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-02820b33-c63a-4d85-bfc2-51660c6edd06 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:13 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-02820b33-c63a-4d85-bfc2-51660c6edd06 1073741824 Jul 01 04:03:13 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-8693fcc0-6465-42e5-af79-8064afef9a94 req-be1a8883-ce41-4fae-a516-0e3eabf84f08 tempest-AttachVolumeTestJSON-133197759 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd069122-fee9-4b5d-a8a3-00026c1c29bb', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:03:13 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-8693fcc0-6465-42e5-af79-8064afef9a94 req-be1a8883-ce41-4fae-a516-0e3eabf84f08 tempest-AttachVolumeTestJSON-133197759 None] attachment_update completed successfully. Jul 01 04:03:14 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-02820b33-c63a-4d85-bfc2-51660c6edd06 1073741824" returned: 0 in 0.989s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-02820b33-c63a-4d85-bfc2-51660c6edd06 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:14 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-02820b33-c63a-4d85-bfc2-51660c6edd06 Jul 01 04:03:14 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:15 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-02820b33-c63a-4d85-bfc2-51660c6edd06" returned: 0 in 0.706s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:03:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f665fc6-caf4-4246-b422-9cebbc4ef8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02820b33-c63a-4d85-bfc2-51660c6edd06', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735f7710-ccb4-427d-a087-05c5cee967ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:15 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Volume volume-02820b33-c63a-4d85-bfc2-51660c6edd06 (02820b33-c63a-4d85-bfc2-51660c6edd06): created successfully Jul 01 04:03:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735f7710-ccb4-427d-a087-05c5cee967ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Flow 'volume_create_manager' (3a5f5648-d277-430b-bd3c-f68b43726c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:15 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f3377037-a02c-4175-beee-d0c3554f39a3 tempest-VolumesMetadataTest-1715360854 None] Created volume successfully. Jul 01 04:03:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Acquiring lock "cinder-02820b33-c63a-4d85-bfc2-51660c6edd06-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Lock "cinder-02820b33-c63a-4d85-bfc2-51660c6edd06-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Acquiring lock "cinder-quobyte-02820b33-c63a-4d85-bfc2-51660c6edd06" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Lock "cinder-quobyte-02820b33-c63a-4d85-bfc2-51660c6edd06" acquired by "delete_volume" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:16 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffcb93b-b819-40c7-ba26-75c61ffd26d2]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-02820b33-c63a-4d85-bfc2-51660c6edd06 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:16 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-02820b33-c63a-4d85-bfc2-51660c6edd06 Jul 01 04:03:16 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:17 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-02820b33-c63a-4d85-bfc2-51660c6edd06" returned: 0 in 0.828s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-02820b33-c63a-4d85-bfc2-51660c6edd06 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:17 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-02820b33-c63a-4d85-bfc2-51660c6edd06 Jul 01 04:03:17 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f8b33073-c24c-4745-ac22-9a1e37732551 tempest-BackendsCapabilitiesAdminTestsJSON-2050838873 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7443084716797, 'free_capacity_gb': 1775.7443084716797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86177) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 01 04:03:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-588da9f9-8060-46be-b5ec-2ab9b1e269cd tempest-BackendsCapabilitiesAdminTestsJSON-2050838873 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7443084716797, 'free_capacity_gb': 1775.7443084716797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86177) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 01 04:03:18 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-02820b33-c63a-4d85-bfc2-51660c6edd06" returned: 0 in 0.656s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:18 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Lock "cinder-quobyte-02820b33-c63a-4d85-bfc2-51660c6edd06" released by "delete_volume" :: held 1.519s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:18 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Created reservations ['9b91ddd3-b4c4-4395-8d7b-531ca1bd7823', '7c40a825-0b0f-4ea6-ac57-4ed315e9b3e4', '7ce01dde-7972-46d4-894d-72872da4c1ea', 'b1619b74-4d2e-4857-be82-bbd8124bdd0e'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:03:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:18 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:03:18 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:18 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.678s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:18 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:03:18 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Deleted volume successfully. Jul 01 04:03:18 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-025ca6f6-801e-4db8-b6af-23cc57c446e8 req-65d11ed5-4e22-447d-bb8a-c06ca19386e9 tempest-AttachVolumeTestJSON-133197759 None] Terminate volume connection completed successfully. Jul 01 04:03:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-025ca6f6-801e-4db8-b6af-23cc57c446e8 req-65d11ed5-4e22-447d-bb8a-c06ca19386e9 tempest-AttachVolumeTestJSON-133197759 None] Deleting attachment ed9f91b0-9312-48d5-b889-0666151e6a90. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:03:18 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c277b98d-db4a-444b-9115-74c8d4298896 tempest-VolumesMetadataTest-1715360854 None] Lock "cinder-02820b33-c63a-4d85-bfc2-51660c6edd06-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:21 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-26ea86a0-0137-4ccb-bd93-a7be8030edd1 req-7c1fbd81-3082-4085-b8ef-3c2fd1200011 tempest-AttachVolumeTestJSON-133197759 None] Terminate volume connection completed successfully. Jul 01 04:03:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-26ea86a0-0137-4ccb-bd93-a7be8030edd1 req-7c1fbd81-3082-4085-b8ef-3c2fd1200011 tempest-AttachVolumeTestJSON-133197759 None] Deleting attachment fd069122-fee9-4b5d-a8a3-00026c1c29bb. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Flow 'volume_create_manager' (1933066b-5964-4abe-9101-f156cf07da46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5568b88-786a-4dc3-af3b-3b71fd0166af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5568b88-786a-4dc3-af3b-3b71fd0166af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1483123092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd2aefc-68f0-404d-83c5-9fca72bc235b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd808ae12136471c918ce4524ba4d462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:22Z,use_quota=True,user_id='601384d364a84a439c0cc2581d71f815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c118afa-ee24-443f-80a6-aa42d88f4744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c118afa-ee24-443f-80a6-aa42d88f4744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4118d97f-9dba-402b-98e5-b9fb8a2ee7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4118d97f-9dba-402b-98e5-b9fb8a2ee7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd2aefc-68f0-404d-83c5-9fca72bc235b', 'volume_name': 'volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade388f7-196c-4112-9544-a1528cb160c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade388f7-196c-4112-9544-a1528cb160c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f867f89-49bc-4588-ab9b-bc439943941c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:22 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Volume 5fd2aefc-68f0-404d-83c5-9fca72bc235b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b', 'volume_size': 1} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1483123092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd2aefc-68f0-404d-83c5-9fca72bc235b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd808ae12136471c918ce4524ba4d462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:22Z,use_quota=True,user_id='601384d364a84a439c0cc2581d71f815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Creating volume 5fd2aefc-68f0-404d-83c5-9fca72bc235b {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:03:22 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:03:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:22 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b 1073741824 Jul 01 04:03:22 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:23 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b 1073741824" returned: 0 in 0.893s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:23 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b Jul 01 04:03:23 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:23 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b" returned: 0 in 0.707s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:03:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f867f89-49bc-4588-ab9b-bc439943941c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce90d437-d605-4802-b7a1-fdb42cb4fc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:23 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Volume volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b (5fd2aefc-68f0-404d-83c5-9fca72bc235b): created successfully Jul 01 04:03:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce90d437-d605-4802-b7a1-fdb42cb4fc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Flow 'volume_create_manager' (1933066b-5964-4abe-9101-f156cf07da46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:23 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-07ae2412-22a5-464b-8cab-2cefbcb04f1c tempest-VolumesCloneTest-239661825 None] Created volume successfully. Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:24 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:03:24 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Flow 'volume_create_manager' (60033e52-3779-4110-8889-b4c445312754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb0acc2-32c5-44ed-828d-4239c9179af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb0acc2-32c5-44ed-828d-4239c9179af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-14298435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da327081-d579-4af9-928d-a6286c3f6c45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd808ae12136471c918ce4524ba4d462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5fd2aefc-68f0-404d-83c5-9fca72bc235b,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:25Z,use_quota=True,user_id='601384d364a84a439c0cc2581d71f815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6161f141-a961-4e36-b3f8-037b621d3e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6161f141-a961-4e36-b3f8-037b621d3e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48350434-a5ba-4f44-b1a5-2fd31471356f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48350434-a5ba-4f44-b1a5-2fd31471356f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'da327081-d579-4af9-928d-a6286c3f6c45', 'volume_name': 'volume-da327081-d579-4af9-928d-a6286c3f6c45', 'volume_size': 2, 'source_volid': '5fd2aefc-68f0-404d-83c5-9fca72bc235b', 'source_volstatus': 'available'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b538e88-1b4e-428c-afd9-4394dfa00e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b538e88-1b4e-428c-afd9-4394dfa00e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af50ef2-fb83-4e64-81e1-069db1a3209f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:24 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Volume da327081-d579-4af9-928d-a6286c3f6c45: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-da327081-d579-4af9-928d-a6286c3f6c45', 'volume_size': 2, 'source_volid': '5fd2aefc-68f0-404d-83c5-9fca72bc235b', 'source_volstatus': 'available'} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:24 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Cloning volume 5fd2aefc-68f0-404d-83c5-9fca72bc235b to volume da327081-d579-4af9-928d-a6286c3f6c45 Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Creating offline snapshot 2049bb82-4e9c-42a1-a387-d5882f3d131c of volume 5fd2aefc-68f0-404d-83c5-9fca72bc235b {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ffb7a3-4154-4e1d-ae12-7f2aec4d99c3]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:25 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b Jul 01 04:03:25 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:25 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.905s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:03:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:03:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 28 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:03:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:03:26 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b" returned: 0 in 1.294s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:26 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c 1G Jul 01 04:03:26 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:27 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c 1G" returned: 0 in 1.325s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:27 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c Jul 01 04:03:27 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:28 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c" returned: 0 in 0.939s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:28 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c is being set with open permissions: ugo+rw Jul 01 04:03:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:28 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c Jul 01 04:03:28 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:29 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c" returned: 0 in 0.797s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:29 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.info Jul 01 04:03:29 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:30 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.info" returned: 0 in 0.781s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:30 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.info is being set with open permissions: ugo+rw Jul 01 04:03:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:30 devstack sudo[93433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.info Jul 01 04:03:30 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:30 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.info" returned: 0 in 0.684s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Acquiring lock "cinder-quobyte-da327081-d579-4af9-928d-a6286c3f6c45" by "_copy_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Lock "cinder-quobyte-da327081-d579-4af9-928d-a6286c3f6c45" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] snapshot: 2049bb82-4e9c-42a1-a387-d5882f3d131c, volume: da327081-d579-4af9-928d-a6286c3f6c45, {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 04:03:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:30 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb25301-8013-4e96-9905-10f63a2b8f06]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:31 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1390c8a7-0b8a-4417-8efe-d4266bb7723a tempest-GroupsTest-1937768813 None] Group tempest-Group1-59556965: creating Jul 01 04:03:31 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1390c8a7-0b8a-4417-8efe-d4266bb7723a tempest-GroupsTest-1937768813 None] Group tempest-Group1-59556965: created successfully Jul 01 04:03:31 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1390c8a7-0b8a-4417-8efe-d4266bb7723a tempest-GroupsTest-1937768813 None] Create group completed successfully. Jul 01 04:03:31 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c Jul 01 04:03:31 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:31 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c" returned: 0 in 0.914s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:03:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 04:03:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Creating direct copy from snapshot {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 04:03:31 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b4484a-4842-4622-acbf-fade0cbc499f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:31 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b Jul 01 04:03:31 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "cinder-61af572b-2f3a-48e9-8fb5-431ed6d36bce-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Lock "cinder-61af572b-2f3a-48e9-8fb5-431ed6d36bce-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:32 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-10617f2b-6594-4e80-9778-1229d4be8158 tempest-GroupsTest-1937768813 None] Group tempest-Group2-1333676843: creating Jul 01 04:03:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "cinder-quobyte-61af572b-2f3a-48e9-8fb5-431ed6d36bce" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:32 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-10617f2b-6594-4e80-9778-1229d4be8158 tempest-GroupsTest-1937768813 None] Group tempest-Group2-1333676843: created successfully Jul 01 04:03:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Lock "cinder-quobyte-61af572b-2f3a-48e9-8fb5-431ed6d36bce" acquired by "delete_volume" :: waited 0.029s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:32 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-10617f2b-6594-4e80-9778-1229d4be8158 tempest-GroupsTest-1937768813 None] Create group completed successfully. Jul 01 04:03:32 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4accfd-99c2-4f12-a834-602f96dc08b5]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:32 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce Jul 01 04:03:32 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:32 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b" returned: 0 in 0.893s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:32 devstack cinder-volume[86177]: DEBUG cinder.utils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Path /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-da327081-d579-4af9-928d-a6286c3f6c45 not found in is_blk_device check {{(pid=86177) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 04:03:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-da327081-d579-4af9-928d-a6286c3f6c45 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:32 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-da327081-d579-4af9-928d-a6286c3f6c45 Jul 01 04:03:32 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:33 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce" returned: 0 in 0.777s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:33 devstack sudo[93453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce Jul 01 04:03:33 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Flow 'volume_create_manager' (5c338aaa-45c6-4216-b494-cd87172dd402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c07431a-d53d-46ba-afce-fb33384ee94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c07431a-d53d-46ba-afce-fb33384ee94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-845833008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33fdc3ca-5a28-4cd2-a71b-e116799c9c97,host='devstack@QuobyteHD#QuobyteHD',id=290e96a3-bb55-4722-ad30-cf4451b10b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed117f8ff09426c9c3c126acdbb5fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:34Z,use_quota=True,user_id='685d2a223b3e4176a108b7e3e1227d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6a5151-622f-4b3d-846e-621a77a891b9),volume_type_id=df6a5151-622f-4b3d-846e-621a77a891b9)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50430e84-5e45-4ba2-a2d2-e1a930c7ad9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50430e84-5e45-4ba2-a2d2-e1a930c7ad9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5454419-df55-40e1-8348-1ce56978a113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5454419-df55-40e1-8348-1ce56978a113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '290e96a3-bb55-4722-ad30-cf4451b10b8a', 'volume_name': 'volume-290e96a3-bb55-4722-ad30-cf4451b10b8a', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c917c8-334b-4af7-a247-32e8fd83db00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c917c8-334b-4af7-a247-32e8fd83db00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46caa27-51fe-4fe2-b6e3-52ee8eb1837f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:34 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Volume 290e96a3-bb55-4722-ad30-cf4451b10b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-290e96a3-bb55-4722-ad30-cf4451b10b8a', 'volume_size': 1} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:34 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-61af572b-2f3a-48e9-8fb5-431ed6d36bce" returned: 0 in 1.406s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Lock "cinder-quobyte-61af572b-2f3a-48e9-8fb5-431ed6d36bce" released by "delete_volume" :: held 2.244s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Created reservations ['3d15cbf6-9f0f-4805-b109-8cdaaae785d0', 'ff3d11f9-e46b-45e0-a41e-68207258ebe5', '75fd2808-20ab-4210-9f18-675e850eb08d', '5e5ad1bb-d7ea-4e6d-8f66-520694dd1b0b'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:35 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:03:35 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "cinder-c61198bd-abb4-4dfa-8357-495ea433e549-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:36 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Lock "cinder-c61198bd-abb4-4dfa-8357-495ea433e549-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:36 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "cinder-quobyte-c61198bd-abb4-4dfa-8357-495ea433e549" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:36 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Lock "cinder-quobyte-c61198bd-abb4-4dfa-8357-495ea433e549" acquired by "delete_volume" :: waited 0.041s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:36 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f7c957-7ca5-44d6-b5f7-5f6119cd4370]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c61198bd-abb4-4dfa-8357-495ea433e549 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:36 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.560s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:36 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:03:36 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Deleted volume successfully. Jul 01 04:03:36 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f4945c71-1fdd-4583-ae11-c86ee3031542 tempest-AttachVolumeTestJSON-133197759 None] Lock "cinder-61af572b-2f3a-48e9-8fb5-431ed6d36bce-delete_volume" released by "delete_volume" :: held 4.262s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:36 devstack sudo[93484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c61198bd-abb4-4dfa-8357-495ea433e549 Jul 01 04:03:36 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:37 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Acquiring lock "cinder-8f04a84c-e138-466c-a065-a09a7d196a94-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:37 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Lock "cinder-8f04a84c-e138-466c-a065-a09a7d196a94-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:37 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Acquiring lock "cinder-quobyte-8f04a84c-e138-466c-a065-a09a7d196a94" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:37 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Lock "cinder-quobyte-8f04a84c-e138-466c-a065-a09a7d196a94" acquired by "delete_volume" :: waited 0.040s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:37 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d6aa98-7e2c-49a9-973e-567399fb1743]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8f04a84c-e138-466c-a065-a09a7d196a94 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:37 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8f04a84c-e138-466c-a065-a09a7d196a94 Jul 01 04:03:37 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:37 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c61198bd-abb4-4dfa-8357-495ea433e549" returned: 0 in 1.573s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c61198bd-abb4-4dfa-8357-495ea433e549 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:38 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c61198bd-abb4-4dfa-8357-495ea433e549 Jul 01 04:03:38 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:39 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:39 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-da327081-d579-4af9-928d-a6286c3f6c45" returned: 0 in 6.390s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c61198bd-abb4-4dfa-8357-495ea433e549" returned: 0 in 1.157s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:39 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec49c9b-8b51-4d8d-bcd6-b14f234003ef]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Lock "cinder-quobyte-c61198bd-abb4-4dfa-8357-495ea433e549" released by "delete_volume" :: held 2.869s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8f04a84c-e138-466c-a065-a09a7d196a94" returned: 0 in 1.691s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8f04a84c-e138-466c-a065-a09a7d196a94 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:39 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8f04a84c-e138-466c-a065-a09a7d196a94 Jul 01 04:03:39 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Created reservations ['07248477-e82d-4de9-be01-78069a048388', '69a797b4-6459-43df-a392-d4acd112e26d', 'e65a1820-3d77-4a22-bf52-c9f4a0438c74', '743d6ef9-bf84-40f2-9aa3-fba89a3fcea6'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:03:39 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b Jul 01 04:03:39 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:39 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:03:39 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "cinder-cdfd59a5-8310-4a10-90e0-6040c572ac6a-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:39 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8f04a84c-e138-466c-a065-a09a7d196a94" returned: 0 in 0.714s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Lock "cinder-cdfd59a5-8310-4a10-90e0-6040c572ac6a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Lock "cinder-quobyte-8f04a84c-e138-466c-a065-a09a7d196a94" released by "delete_volume" :: held 2.543s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Created reservations ['dcdbac6d-ec14-412c-8b1a-27adbbb108e3', '432faec1-d2df-4b94-bbbe-0d9ffebee0eb', 'c9803a2f-c80b-4634-8d9e-4fce39949770', 'fcda0eaf-861c-4b32-b849-fe442c3186c6'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:03:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "cinder-quobyte-cdfd59a5-8310-4a10-90e0-6040c572ac6a" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:40 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Lock "cinder-quobyte-cdfd59a5-8310-4a10-90e0-6040c572ac6a" acquired by "delete_volume" :: waited 0.028s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.726s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[20af2f90-acf4-464c-bc22-56f18cde087e]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:40 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Deleted volume successfully. Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f2af1704-fb74-41a7-b93f-fee166ed82e0 tempest-AttachVolumeTestJSON-133197759 None] Lock "cinder-c61198bd-abb4-4dfa-8357-495ea433e549-delete_volume" released by "delete_volume" :: held 4.065s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:40 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:03:40 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:40 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a Jul 01 04:03:40 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:40 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b" returned: 0 in 1.035s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Image conversion details: src /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-da327081-d579-4af9-928d-a6286c3f6c45 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:03:40 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Converted 1024.00 MB image at 160.21 MB/s Jul 01 04:03:40 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-da327081-d579-4af9-928d-a6286c3f6c45 is being set with open permissions: ugo+rw Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-da327081-d579-4af9-928d-a6286c3f6c45 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:40 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-da327081-d579-4af9-928d-a6286c3f6c45 Jul 01 04:03:40 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:40 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.724s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:03:40 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Deleted volume successfully. Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0c6c0a14-e141-4be9-b176-f478593f58b7 tempest-AttachVolumeShelveTestJSON-539019461 None] Lock "cinder-8f04a84c-e138-466c-a065-a09a7d196a94-delete_volume" released by "delete_volume" :: held 3.669s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:40 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a" returned: 0 in 0.842s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:40 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-da327081-d579-4af9-928d-a6286c3f6c45" returned: 0 in 0.731s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:40 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a Jul 01 04:03:40 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Lock "cinder-quobyte-da327081-d579-4af9-928d-a6286c3f6c45" released by "_copy_volume_from_snapshot" :: held 10.056s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Acquiring lock "cinder-quobyte-2049bb82-4e9c-42a1-a387-d5882f3d131c" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Lock "cinder-quobyte-2049bb82-4e9c-42a1-a387-d5882f3d131c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Deleting offline snapshot 2049bb82-4e9c-42a1-a387-d5882f3d131c of volume 5fd2aefc-68f0-404d-83c5-9fca72bc235b {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] snapshot_file for this snap is: volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46c7610-2133-473a-9390-4e77bfa55bf7]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:41 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c Jul 01 04:03:41 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:41 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cdfd59a5-8310-4a10-90e0-6040c572ac6a" returned: 0 in 0.685s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Lock "cinder-quobyte-cdfd59a5-8310-4a10-90e0-6040c572ac6a" released by "delete_volume" :: held 1.575s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Created reservations ['d601c96a-404d-478a-945b-69185db69b2a', '03b1ef29-2d03-4e5c-974e-ef84eec36b96', '5c228b91-6c49-4cd9-801d-bc25c6ad9a82', '921ab785-18b5-4a2f-997f-ebb10727e555'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:41 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:03:41 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:41 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c" returned: 0 in 0.847s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1265b542-6679-4c7a-bc6d-085992ac8c74]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:42 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b Jul 01 04:03:42 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:42 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.779s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:42 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:03:42 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Deleted volume successfully. Jul 01 04:03:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-28857aee-b4bf-497e-a06b-8c027750dab1 tempest-AttachVolumeTestJSON-133197759 None] Lock "cinder-cdfd59a5-8310-4a10-90e0-6040c572ac6a-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:42 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b" returned: 0 in 0.999s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:42 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c Jul 01 04:03:42 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:43 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c" returned: 0 in 0.792s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:43 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c Jul 01 04:03:43 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:44 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b.2049bb82-4e9c-42a1-a387-d5882f3d131c" returned: 0 in 0.888s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Lock "cinder-quobyte-2049bb82-4e9c-42a1-a387-d5882f3d131c" released by "_delete_snapshot" :: held 3.651s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.754s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.074s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=33fdc3ca-5a28-4cd2-a71b-e116799c9c97,created_at=2026-07-01T02:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-845833008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33fdc3ca-5a28-4cd2-a71b-e116799c9c97,host='devstack@QuobyteHD#QuobyteHD',id=290e96a3-bb55-4722-ad30-cf4451b10b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed117f8ff09426c9c3c126acdbb5fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:34Z,use_quota=True,user_id='685d2a223b3e4176a108b7e3e1227d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6a5151-622f-4b3d-846e-621a77a891b9),volume_type_id=df6a5151-622f-4b3d-846e-621a77a891b9)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Creating volume 290e96a3-bb55-4722-ad30-cf4451b10b8a {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:03:44 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-290e96a3-bb55-4722-ad30-cf4451b10b8a 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:44 devstack sudo[93548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-290e96a3-bb55-4722-ad30-cf4451b10b8a 1073741824 Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af50ef2-fb83-4e64-81e1-069db1a3209f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da327081-d579-4af9-928d-a6286c3f6c45', 'volume_size': 2, 'source_volid': '5fd2aefc-68f0-404d-83c5-9fca72bc235b', 'source_volstatus': 'available'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:44 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead4f40d-c93c-487a-af0c-f49ed45af0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:44 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Volume volume-da327081-d579-4af9-928d-a6286c3f6c45 (da327081-d579-4af9-928d-a6286c3f6c45): created successfully Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead4f40d-c93c-487a-af0c-f49ed45af0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Flow 'volume_create_manager' (60033e52-3779-4110-8889-b4c445312754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:44 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-eaf21931-1c6f-48df-97e0-ba04621411de tempest-VolumesCloneTest-239661825 None] Created volume successfully. Jul 01 04:03:45 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-290e96a3-bb55-4722-ad30-cf4451b10b8a 1073741824" returned: 0 in 1.216s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-290e96a3-bb55-4722-ad30-cf4451b10b8a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:46 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-290e96a3-bb55-4722-ad30-cf4451b10b8a Jul 01 04:03:46 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Acquiring lock "cinder-da327081-d579-4af9-928d-a6286c3f6c45-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Lock "cinder-da327081-d579-4af9-928d-a6286c3f6c45-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Acquiring lock "cinder-quobyte-da327081-d579-4af9-928d-a6286c3f6c45" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Lock "cinder-quobyte-da327081-d579-4af9-928d-a6286c3f6c45" acquired by "delete_volume" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:46 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[35382f35-5fc3-4132-bf6b-57fc78bb8f27]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-da327081-d579-4af9-928d-a6286c3f6c45 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:46 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-da327081-d579-4af9-928d-a6286c3f6c45 Jul 01 04:03:46 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:46 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-290e96a3-bb55-4722-ad30-cf4451b10b8a" returned: 0 in 0.776s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] <== create_volume: return (2061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:03:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46caa27-51fe-4fe2-b6e3-52ee8eb1837f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-290e96a3-bb55-4722-ad30-cf4451b10b8a', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5a48ba-dab1-4a73-b5d5-65762fa6ebd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:46 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Volume volume-290e96a3-bb55-4722-ad30-cf4451b10b8a (290e96a3-bb55-4722-ad30-cf4451b10b8a): created successfully Jul 01 04:03:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5a48ba-dab1-4a73-b5d5-65762fa6ebd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Flow 'volume_create_manager' (5c338aaa-45c6-4216-b494-cd87172dd402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:46 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-974c89d7-c0ce-4e8f-bd4f-f2e9119d311e tempest-GroupsTest-1937768813 None] Created volume successfully. Jul 01 04:03:47 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-da327081-d579-4af9-928d-a6286c3f6c45" returned: 0 in 0.990s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-da327081-d579-4af9-928d-a6286c3f6c45 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:47 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-da327081-d579-4af9-928d-a6286c3f6c45 Jul 01 04:03:47 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Acquiring lock "cinder-quobyte-290e96a3-bb55-4722-ad30-cf4451b10b8a" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Lock "cinder-quobyte-290e96a3-bb55-4722-ad30-cf4451b10b8a" acquired by "delete_volume" :: waited 0.030s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:48 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-da327081-d579-4af9-928d-a6286c3f6c45" returned: 0 in 0.847s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Lock "cinder-quobyte-da327081-d579-4af9-928d-a6286c3f6c45" released by "delete_volume" :: held 1.894s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f13dfb-6bbb-4dc1-8826-4be73f22f2a9]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-290e96a3-bb55-4722-ad30-cf4451b10b8a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Created reservations ['aef0e8a5-21f5-4667-98e7-7b00e31b3103', '7002373f-c6ba-4bce-9367-509bf9df9164', 'a3f9f29a-ce3f-4428-a992-b6260eee933d', 'bf47eb34-8662-43d6-8ea5-1fe48f23695b'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:03:48 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-290e96a3-bb55-4722-ad30-cf4451b10b8a Jul 01 04:03:48 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:48 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:03:48 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Acquiring lock "cinder-5fd2aefc-68f0-404d-83c5-9fca72bc235b-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Lock "cinder-5fd2aefc-68f0-404d-83c5-9fca72bc235b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Acquiring lock "cinder-quobyte-5fd2aefc-68f0-404d-83c5-9fca72bc235b" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Lock "cinder-quobyte-5fd2aefc-68f0-404d-83c5-9fca72bc235b" acquired by "delete_volume" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[be802c87-6153-4d09-840c-a72b5e5cac08]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:49 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b Jul 01 04:03:49 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:49 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-290e96a3-bb55-4722-ad30-cf4451b10b8a" returned: 0 in 1.135s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-290e96a3-bb55-4722-ad30-cf4451b10b8a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:49 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-290e96a3-bb55-4722-ad30-cf4451b10b8a Jul 01 04:03:49 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:03:49 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Flow 'volume_create_manager' (23fb6e3d-f24b-4cac-9dda-8228ae34e562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcb06a3-a06d-4a90-8f1d-3ccf8224f4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.055s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcb06a3-a06d-4a90-8f1d-3ccf8224f4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-315001636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d71999-9783-4e3d-8a9c-77931ac09944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558f51dae878416fb1907540428c9d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:50Z,use_quota=True,user_id='e5be9a362d484480bf03aa8bdbe91111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215a18ff-c12d-4388-947b-6274abdcbb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215a18ff-c12d-4388-947b-6274abdcbb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c190c3b-2ff7-4842-aad0-3de60b4eaf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c190c3b-2ff7-4842-aad0-3de60b4eaf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d71999-9783-4e3d-8a9c-77931ac09944', 'volume_name': 'volume-a4d71999-9783-4e3d-8a9c-77931ac09944', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446f3f8d-78ae-46c9-82a2-9a524da686f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446f3f8d-78ae-46c9-82a2-9a524da686f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84be7545-071a-4008-9b5b-44b9ca1b5da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:49 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Volume a4d71999-9783-4e3d-8a9c-77931ac09944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d71999-9783-4e3d-8a9c-77931ac09944', 'volume_size': 1} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-315001636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d71999-9783-4e3d-8a9c-77931ac09944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558f51dae878416fb1907540428c9d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:50Z,use_quota=True,user_id='e5be9a362d484480bf03aa8bdbe91111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Creating volume a4d71999-9783-4e3d-8a9c-77931ac09944 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:03:49 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:49 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Deleted volume successfully. Jul 01 04:03:49 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944 1073741824 Jul 01 04:03:49 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2e4e52d9-7e8f-4ad4-88b1-4fe7f144c344 tempest-VolumesCloneTest-239661825 None] Lock "cinder-da327081-d579-4af9-928d-a6286c3f6c45-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:49 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b" returned: 0 in 1.023s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:50 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b Jul 01 04:03:50 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:50 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-290e96a3-bb55-4722-ad30-cf4451b10b8a" returned: 0 in 0.888s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Lock "cinder-quobyte-290e96a3-bb55-4722-ad30-cf4451b10b8a" released by "delete_volume" :: held 2.102s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:50 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Created reservations ['6195decb-f5df-4a28-ad53-d264f9b62748'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:03:50 devstack cinder-volume[86177]: WARNING cinder.quota [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-977705521 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-977705521, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:03:50 devstack cinder-volume[86177]: WARNING cinder.quota [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-977705521 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-977705521, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:03:50 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Created reservations ['8738079c-6227-444a-9e27-9c57e4fbf8a0', '5d80b3d0-1a32-49ba-87d2-df88946dc763', 'f80aea03-6b56-4fcd-b076-ba7815e01650', 'ab676a88-8b1c-4301-804f-0d7423646dbd'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:03:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:50 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:03:50 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:50 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5fd2aefc-68f0-404d-83c5-9fca72bc235b" returned: 0 in 0.804s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Lock "cinder-quobyte-5fd2aefc-68f0-404d-83c5-9fca72bc235b" released by "delete_volume" :: held 1.924s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:50 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944 1073741824" returned: 0 in 1.177s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Created reservations ['ec491d89-6665-4c71-9f54-8b8fd5d6df76', 'da15e764-5379-4c8f-ad18-9920caf24d6a', '213f64e6-c552-4255-b85d-75298c189519', 'a57cd6bf-61ff-4781-a276-0250d6c0f6b6'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-dad84591-af91-4e6b-93f8-b96463a68cc3 tempest-GroupsTest-1937768813 None] Created reservations ['8f973fa7-19fd-4c1d-9831-a45a1221df0a'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:03:51 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944 Jul 01 04:03:51 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:51 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:03:51 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-dad84591-af91-4e6b-93f8-b96463a68cc3 tempest-GroupsTest-1937768813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-dad84591-af91-4e6b-93f8-b96463a68cc3 tempest-GroupsTest-1937768813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-dad84591-af91-4e6b-93f8-b96463a68cc3 tempest-GroupsTest-1937768813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-dad84591-af91-4e6b-93f8-b96463a68cc3 tempest-GroupsTest-1937768813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-dad84591-af91-4e6b-93f8-b96463a68cc3 tempest-GroupsTest-1937768813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dad84591-af91-4e6b-93f8-b96463a68cc3 tempest-GroupsTest-1937768813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:51 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:03:51 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:51 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.892s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:03:51 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-3ef0779d-7098-4772-b632-98245a21c90c tempest-GroupsTest-1937768813 None] Delete group completed successfully. Jul 01 04:03:51 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.807s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:51 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:03:51 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Deleted volume successfully. Jul 01 04:03:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6ff5b7b7-f5d8-48b5-853b-0fd84c96e3db tempest-VolumesCloneTest-239661825 None] Lock "cinder-5fd2aefc-68f0-404d-83c5-9fca72bc235b-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:03:52 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944" returned: 0 in 1.083s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] <== create_volume: return (2421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:03:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.425s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84be7545-071a-4008-9b5b-44b9ca1b5da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d71999-9783-4e3d-8a9c-77931ac09944', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a1d673-da31-4e15-9761-0bf71c7d563d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:52 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:52 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Volume volume-a4d71999-9783-4e3d-8a9c-77931ac09944 (a4d71999-9783-4e3d-8a9c-77931ac09944): created successfully Jul 01 04:03:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a1d673-da31-4e15-9761-0bf71c7d563d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Flow 'volume_create_manager' (23fb6e3d-f24b-4cac-9dda-8228ae34e562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dad84591-af91-4e6b-93f8-b96463a68cc3 tempest-GroupsTest-1937768813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.950s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:52 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-dad84591-af91-4e6b-93f8-b96463a68cc3 tempest-GroupsTest-1937768813 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:03:52 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-dad84591-af91-4e6b-93f8-b96463a68cc3 tempest-GroupsTest-1937768813 None] Delete group completed successfully. Jul 01 04:03:52 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-0612f0b4-b42a-455e-a1ea-136f0bc845d2 req-de01acbd-c534-42ad-9d6a-00285f7da6d5 tempest-VolumesSnapshotsTestJSON-880101186 None] Created volume successfully. Jul 01 04:03:52 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-23254402-ad7f-4a72-ac52-88133ace4b6e tempest-GroupsTest-1937768813 None] Group tempest-GroupsTest-Group-1007856388: creating Jul 01 04:03:52 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-23254402-ad7f-4a72-ac52-88133ace4b6e tempest-GroupsTest-1937768813 None] Group tempest-GroupsTest-Group-1007856388: created successfully Jul 01 04:03:52 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-23254402-ad7f-4a72-ac52-88133ace4b6e tempest-GroupsTest-1937768813 None] Create group completed successfully. Jul 01 04:03:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] Creating offline snapshot 22003c2e-00c4-4786-b769-11ad430e3aee of volume a4d71999-9783-4e3d-8a9c-77931ac09944 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:03:53 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b644bee-34cc-4b2c-a18e-9d3742153cef]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:53 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944 Jul 01 04:03:53 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:54 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944" returned: 0 in 1.169s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:54 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:03:54 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee 1G Jul 01 04:03:54 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Flow 'volume_create_manager' (0dcea681-228d-48c2-a4b9-bc52ea92fd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0ef087-12dd-42dd-a4f8-177a6d7fe0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0ef087-12dd-42dd-a4f8-177a6d7fe0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2029352611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=982be2f5-9b3b-4434-8ac8-65fb395172f3,host='devstack@QuobyteHD#QuobyteHD',id=81ab8e01-af5c-4350-a197-73360b2eed76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed117f8ff09426c9c3c126acdbb5fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:54Z,use_quota=True,user_id='685d2a223b3e4176a108b7e3e1227d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34c73b3f-6b34-4ac3-ab6a-978f7bb48259),volume_type_id=34c73b3f-6b34-4ac3-ab6a-978f7bb48259)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72bdc9a-1a50-4b8c-969e-419789948db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72bdc9a-1a50-4b8c-969e-419789948db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96008823-5b8e-4bc0-b195-c20cad5390cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96008823-5b8e-4bc0-b195-c20cad5390cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81ab8e01-af5c-4350-a197-73360b2eed76', 'volume_name': 'volume-81ab8e01-af5c-4350-a197-73360b2eed76', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de3ec52-c5d1-4b2c-9cda-9813d68a5acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de3ec52-c5d1-4b2c-9cda-9813d68a5acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef8b82a-d271-4df7-ac4d-32ebaee821cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:54 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Volume 81ab8e01-af5c-4350-a197-73360b2eed76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81ab8e01-af5c-4350-a197-73360b2eed76', 'volume_size': 1} Jul 01 04:03:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:55 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee 1G" returned: 0 in 1.084s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d71999-9783-4e3d-8a9c-77931ac09944 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:55 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d71999-9783-4e3d-8a9c-77931ac09944 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee Jul 01 04:03:55 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:56 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:03:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Flow 'volume_create_manager' (3417a368-b8d3-45a8-bdfc-0d2e42dc950b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:03:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa97d73c-4f2b-4c89-a98d-78efe1ad76dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa97d73c-4f2b-4c89-a98d-78efe1ad76dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-815252007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235acb37-d604-4047-8010-f4c4ec4900cb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4e92dd14baeb47cb89d9679d0e234a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:56Z,use_quota=True,user_id='977ce7ae30cd48cd90c7d54694050280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6568ea01-feb9-4c98-a1d8-98277a158917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6568ea01-feb9-4c98-a1d8-98277a158917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7935c2-5f9e-4bc7-9f07-63bc4ca689dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7935c2-5f9e-4bc7-9f07-63bc4ca689dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '235acb37-d604-4047-8010-f4c4ec4900cb', 'volume_name': 'volume-235acb37-d604-4047-8010-f4c4ec4900cb', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46267075-632c-4b8e-9a2f-0bf1aaf430a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46267075-632c-4b8e-9a2f-0bf1aaf430a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:03:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc52cdc-c4be-40f0-8b02-6e2b8cb1d4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:03:56 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Volume 235acb37-d604-4047-8010-f4c4ec4900cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-235acb37-d604-4047-8010-f4c4ec4900cb', 'volume_size': 1} Jul 01 04:03:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:56 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d71999-9783-4e3d-8a9c-77931ac09944 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee" returned: 0 in 0.980s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:56 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee is being set with open permissions: ugo+rw Jul 01 04:03:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:56 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee Jul 01 04:03:56 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:57 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee" returned: 0 in 0.695s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:57 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.info Jul 01 04:03:57 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:58 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.info" returned: 0 in 0.666s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:58 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.info is being set with open permissions: ugo+rw Jul 01 04:03:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:58 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.info Jul 01 04:03:58 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:58 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.info" returned: 0 in 0.694s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.404s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.012s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=982be2f5-9b3b-4434-8ac8-65fb395172f3,created_at=2026-07-01T02:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2029352611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=982be2f5-9b3b-4434-8ac8-65fb395172f3,host='devstack@QuobyteHD#QuobyteHD',id=81ab8e01-af5c-4350-a197-73360b2eed76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed117f8ff09426c9c3c126acdbb5fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:54Z,use_quota=True,user_id='685d2a223b3e4176a108b7e3e1227d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34c73b3f-6b34-4ac3-ab6a-978f7bb48259),volume_type_id=34c73b3f-6b34-4ac3-ab6a-978f7bb48259)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:03:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Creating volume 81ab8e01-af5c-4350-a197-73360b2eed76 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:03:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:03:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:03:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:03:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:03:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:03:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:03:58 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:03:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-81ab8e01-af5c-4350-a197-73360b2eed76 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:58 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-81ab8e01-af5c-4350-a197-73360b2eed76 1073741824 Jul 01 04:03:58 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:58 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-a3e0023a-c435-4dc0-b8b7-b1bd259872e1 req-bc275ab4-a239-4e4c-bbe0-e9a1f3fb1fb7 tempest-VolumesSnapshotsTestJSON-880101186 None] Create snapshot completed successfully Jul 01 04:03:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Acquiring lock "cinder-22003c2e-00c4-4786-b769-11ad430e3aee-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "cinder-22003c2e-00c4-4786-b769-11ad430e3aee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Acquiring lock "cinder-quobyte-a4d71999-9783-4e3d-8a9c-77931ac09944" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "cinder-quobyte-a4d71999-9783-4e3d-8a9c-77931ac09944" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Acquiring lock "cinder-quobyte-22003c2e-00c4-4786-b769-11ad430e3aee" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:03:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "cinder-quobyte-22003c2e-00c4-4786-b769-11ad430e3aee" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:03:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Deleting offline snapshot 22003c2e-00c4-4786-b769-11ad430e3aee of volume a4d71999-9783-4e3d-8a9c-77931ac09944 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:03:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] snapshot_file for this snap is: volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:03:59 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[19046ad1-7c08-4942-a3b0-196c365834fc]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:03:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:59 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee Jul 01 04:03:59 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:03:59 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Jul 01 04:03:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-81ab8e01-af5c-4350-a197-73360b2eed76 1073741824" returned: 0 in 0.995s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:03:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-81ab8e01-af5c-4350-a197-73360b2eed76 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:03:59 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-81ab8e01-af5c-4350-a197-73360b2eed76 Jul 01 04:03:59 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:00 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee" returned: 0 in 0.822s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4d71999-9783-4e3d-8a9c-77931ac09944(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b647bc4-2e59-4333-9e74-96986886fb1f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:00 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944 Jul 01 04:04:00 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:00 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-81ab8e01-af5c-4350-a197-73360b2eed76" returned: 0 in 0.867s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.413s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-815252007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235acb37-d604-4047-8010-f4c4ec4900cb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4e92dd14baeb47cb89d9679d0e234a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:03:56Z,use_quota=True,user_id='977ce7ae30cd48cd90c7d54694050280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Creating volume 235acb37-d604-4047-8010-f4c4ec4900cb {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:04:00 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-235acb37-d604-4047-8010-f4c4ec4900cb 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef8b82a-d271-4df7-ac4d-32ebaee821cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81ab8e01-af5c-4350-a197-73360b2eed76', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e2a21e-baf7-4946-aad7-fdc5a50c0ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:00 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-235acb37-d604-4047-8010-f4c4ec4900cb 1073741824 Jul 01 04:04:00 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:00 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Volume volume-81ab8e01-af5c-4350-a197-73360b2eed76 (81ab8e01-af5c-4350-a197-73360b2eed76): created successfully Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e2a21e-baf7-4946-aad7-fdc5a50c0ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Flow 'volume_create_manager' (0dcea681-228d-48c2-a4b9-bc52ea92fd96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:00 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-dea31766-08d5-488f-9874-2b75e3162e91 tempest-GroupsTest-1937768813 None] Created volume successfully. Jul 01 04:04:01 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944" returned: 0 in 0.968s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:01 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee Jul 01 04:04:01 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:02 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-235acb37-d604-4047-8010-f4c4ec4900cb 1073741824" returned: 0 in 1.310s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-235acb37-d604-4047-8010-f4c4ec4900cb {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:02 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-235acb37-d604-4047-8010-f4c4ec4900cb Jul 01 04:04:02 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Flow 'volume_create_manager' (72d1cdb9-b1cd-42ae-ab73-381b1dfa23c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec280012-4e32-4c97-ac91-90f94db13365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:02 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee" returned: 0 in 1.604s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec280012-4e32-4c97-ac91-90f94db13365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-160163147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=982be2f5-9b3b-4434-8ac8-65fb395172f3,host='devstack@QuobyteHD#QuobyteHD',id=eeb55e61-3b09-48af-9850-9375b03b2ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed117f8ff09426c9c3c126acdbb5fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:03Z,use_quota=True,user_id='685d2a223b3e4176a108b7e3e1227d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34c73b3f-6b34-4ac3-ab6a-978f7bb48259),volume_type_id=34c73b3f-6b34-4ac3-ab6a-978f7bb48259)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:02 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee Jul 01 04:04:02 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69082fc7-7e0b-4f0d-aa08-ec774d1ebdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69082fc7-7e0b-4f0d-aa08-ec774d1ebdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ddbb22-ba63-4a85-8a73-7db5681dc4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ddbb22-ba63-4a85-8a73-7db5681dc4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb55e61-3b09-48af-9850-9375b03b2ec5', 'volume_name': 'volume-eeb55e61-3b09-48af-9850-9375b03b2ec5', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c69e21c9-5fa9-4dd8-b32a-5298de229751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c69e21c9-5fa9-4dd8-b32a-5298de229751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa55c567-ae21-4e6e-b8c4-740cf34290c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:02 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Volume eeb55e61-3b09-48af-9850-9375b03b2ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb55e61-3b09-48af-9850-9375b03b2ec5', 'volume_size': 1} Jul 01 04:04:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:03 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-235acb37-d604-4047-8010-f4c4ec4900cb" returned: 0 in 1.093s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] <== create_volume: return (2489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.493s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.178s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=982be2f5-9b3b-4434-8ac8-65fb395172f3,created_at=2026-07-01T02:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-160163147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=982be2f5-9b3b-4434-8ac8-65fb395172f3,host='devstack@QuobyteHD#QuobyteHD',id=eeb55e61-3b09-48af-9850-9375b03b2ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed117f8ff09426c9c3c126acdbb5fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:03Z,use_quota=True,user_id='685d2a223b3e4176a108b7e3e1227d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34c73b3f-6b34-4ac3-ab6a-978f7bb48259),volume_type_id=34c73b3f-6b34-4ac3-ab6a-978f7bb48259)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Creating volume eeb55e61-3b09-48af-9850-9375b03b2ec5 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:04:03 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eeb55e61-3b09-48af-9850-9375b03b2ec5 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc52cdc-c4be-40f0-8b02-6e2b8cb1d4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-235acb37-d604-4047-8010-f4c4ec4900cb', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754961b8-b72c-43bd-88d8-e559e1ea0872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:03 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eeb55e61-3b09-48af-9850-9375b03b2ec5 1073741824 Jul 01 04:04:03 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:03 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Volume volume-235acb37-d604-4047-8010-f4c4ec4900cb (235acb37-d604-4047-8010-f4c4ec4900cb): created successfully Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754961b8-b72c-43bd-88d8-e559e1ea0872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Flow 'volume_create_manager' (3417a368-b8d3-45a8-bdfc-0d2e42dc950b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:03 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-fd6c0ef4-9ca0-432c-8f47-3782f3509974 tempest-VolumesGetTest-541378110 None] Created volume successfully. Jul 01 04:04:03 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944.22003c2e-00c4-4786-b769-11ad430e3aee" returned: 0 in 0.861s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "cinder-quobyte-22003c2e-00c4-4786-b769-11ad430e3aee" released by "_delete_snapshot" :: held 4.401s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "cinder-quobyte-a4d71999-9783-4e3d-8a9c-77931ac09944" released by "delete_snapshot" :: held 4.429s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:03 devstack cinder-volume[86177]: DEBUG cinder.quota [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Created reservations ['616b02c5-764c-474e-9409-3b6d642b69ee', '3ec8799d-2a44-40ee-bab5-23e6a45bde6a', '70b2382c-29f3-49b0-a178-35252a54030b', '46b51a66-cf1f-4972-826b-2a714dfd4a23'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:04:03 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Delete snapshot completed successfully. Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-81783b20-66d2-418c-9f6e-a25f9597a37a req-d439d445-f52e-49af-98f4-1420b1aceb08 tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "cinder-22003c2e-00c4-4786-b769-11ad430e3aee-delete_snapshot" released by "delete_snapshot" :: held 4.621s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:04 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eeb55e61-3b09-48af-9850-9375b03b2ec5 1073741824" returned: 0 in 1.131s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eeb55e61-3b09-48af-9850-9375b03b2ec5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:04 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eeb55e61-3b09-48af-9850-9375b03b2ec5 Jul 01 04:04:04 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Flow 'volume_create_manager' (5559bf89-e231-4fea-b89d-86f8b012d2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122b2cd3-b21f-4ff1-bf54-f99675741c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122b2cd3-b21f-4ff1-bf54-f99675741c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1727283113',display_name='tempest-VolumesGetTest-Volume-1750490324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2113cbb9-b62f-4bd5-8995-d7fec87a11ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e92dd14baeb47cb89d9679d0e234a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:04Z,use_quota=True,user_id='977ce7ae30cd48cd90c7d54694050280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a40632-d0a4-4189-922d-1e2c91d3b70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a40632-d0a4-4189-922d-1e2c91d3b70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37efd37e-9ca7-4fd4-82eb-3d1197f4d0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37efd37e-9ca7-4fd4-82eb-3d1197f4d0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2113cbb9-b62f-4bd5-8995-d7fec87a11ec', 'volume_name': 'volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c70cf2-11b4-40bc-b1eb-5cb8eb06ac39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c70cf2-11b4-40bc-b1eb-5cb8eb06ac39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee50c750-5cac-41cf-8355-94f4322cf0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:04 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Volume 2113cbb9-b62f-4bd5-8995-d7fec87a11ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec', 'volume_size': 1} Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Acquiring lock "cinder-a4d71999-9783-4e3d-8a9c-77931ac09944-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "cinder-a4d71999-9783-4e3d-8a9c-77931ac09944-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Acquiring lock "cinder-quobyte-a4d71999-9783-4e3d-8a9c-77931ac09944" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:05 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eeb55e61-3b09-48af-9850-9375b03b2ec5" returned: 0 in 0.715s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.429s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1727283113',display_name='tempest-VolumesGetTest-Volume-1750490324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2113cbb9-b62f-4bd5-8995-d7fec87a11ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e92dd14baeb47cb89d9679d0e234a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:04Z,use_quota=True,user_id='977ce7ae30cd48cd90c7d54694050280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Creating volume 2113cbb9-b62f-4bd5-8995-d7fec87a11ec {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:04:05 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "cinder-quobyte-a4d71999-9783-4e3d-8a9c-77931ac09944" acquired by "delete_volume" :: waited 0.063s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:05 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec 1073741824 Jul 01 04:04:05 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa55c567-ae21-4e6e-b8c4-740cf34290c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb55e61-3b09-48af-9850-9375b03b2ec5', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9aeeaa3-6259-4928-afa0-6cc4b2dd1c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[54054137-b8c2-46b4-9674-ff510a960399]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:05 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Volume volume-eeb55e61-3b09-48af-9850-9375b03b2ec5 (eeb55e61-3b09-48af-9850-9375b03b2ec5): created successfully Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9aeeaa3-6259-4928-afa0-6cc4b2dd1c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:05 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Flow 'volume_create_manager' (72d1cdb9-b1cd-42ae-ab73-381b1dfa23c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:05 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-5e9bae5a-3a04-42c4-86ad-ac23c84e3b99 tempest-GroupsTest-1937768813 None] Created volume successfully. Jul 01 04:04:05 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944 Jul 01 04:04:05 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:06 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec 1073741824" returned: 0 in 1.004s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:06 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944" returned: 0 in 0.926s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:06 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944 Jul 01 04:04:06 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:06 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec Jul 01 04:04:06 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:06 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8f4cf6e9-608e-45b7-8e40-06db1b779b4f tempest-GroupsTest-1937768813 None] Update group completed successfully. Jul 01 04:04:06 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a4d71999-9783-4e3d-8a9c-77931ac09944" returned: 0 in 0.761s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "cinder-quobyte-a4d71999-9783-4e3d-8a9c-77931ac09944" released by "delete_volume" :: held 1.791s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:06 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec" returned: 0 in 0.799s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:04:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:06 devstack cinder-volume[86177]: DEBUG cinder.quota [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Created reservations ['0bdbf34e-e291-4e01-b7f4-61ae284378f5', '6a917a2e-9690-4a5c-8097-d3d749718f67', 'ebba01ed-7f54-410f-af3e-e15e7b229f07', '751f9bcc-1579-4627-b214-5de6e7dfbad7'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:04:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee50c750-5cac-41cf-8355-94f4322cf0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ba8298-8a41-4f13-827c-c161eea1575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:07 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Volume volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec (2113cbb9-b62f-4bd5-8995-d7fec87a11ec): created successfully Jul 01 04:04:07 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ba8298-8a41-4f13-827c-c161eea1575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:07 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Flow 'volume_create_manager' (5559bf89-e231-4fea-b89d-86f8b012d2fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:07 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-129b989d-0c66-45b8-bcfb-f5f5826dd416 tempest-VolumesGetTest-541378110 None] Created volume successfully. Jul 01 04:04:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:07 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:07 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:07 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:04:07 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:07 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.727s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:07 devstack cinder-volume[86177]: DEBUG cinder.manager [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:04:07 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Deleted volume successfully. Jul 01 04:04:07 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=96,cinder:INSERT=21,cinder:UPDATE=126,cinder:DELETE=10 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:04:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-17f5b395-764d-44cb-aa5f-7c3b62c10272 req-bb843636-b408-4d6e-917d-0b52d6ab023f tempest-VolumesSnapshotsTestJSON-880101186 None] Lock "cinder-a4d71999-9783-4e3d-8a9c-77931ac09944-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-2113cbb9-b62f-4bd5-8995-d7fec87a11ec-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Lock "cinder-2113cbb9-b62f-4bd5-8995-d7fec87a11ec-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:07 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=114,cinder:SELECT=101,cinder:DELETE=10,cinder:INSERT=34 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:04:08 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-quobyte-2113cbb9-b62f-4bd5-8995-d7fec87a11ec" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:08 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-2113cbb9-b62f-4bd5-8995-d7fec87a11ec" acquired by "delete_volume" :: waited 0.037s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:08 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad83f75-23af-4a10-af60-1b90b1e6baeb]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:08 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-db7c3579-2423-4237-b775-000de2b55ced tempest-GroupsTest-1937768813 None] Update group completed successfully. Jul 01 04:04:08 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec Jul 01 04:04:08 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:09 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec" returned: 0 in 0.883s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:09 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec Jul 01 04:04:09 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:09 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2113cbb9-b62f-4bd5-8995-d7fec87a11ec" returned: 0 in 0.924s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:10 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-2113cbb9-b62f-4bd5-8995-d7fec87a11ec" released by "delete_volume" :: held 1.896s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:10 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Acquiring lock "cinder-quobyte-81ab8e01-af5c-4350-a197-73360b2eed76" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:10 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Lock "cinder-quobyte-81ab8e01-af5c-4350-a197-73360b2eed76" acquired by "delete_volume" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:10 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9bca29-91e6-429f-b5a6-4d82835f7ab7]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-81ab8e01-af5c-4350-a197-73360b2eed76 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:10 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Created reservations ['578aeb6a-e0de-41f9-ac44-c63fba3ea148', 'c35d2e91-5147-4d83-9e67-adb2513a14a9', 'c278b020-97a6-4b69-9fc1-d2bda8b0e33e', '5baacffc-bdce-45fc-b351-21ec48447391'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:04:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:10 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:10 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:10 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-81ab8e01-af5c-4350-a197-73360b2eed76 Jul 01 04:04:10 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:10 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:04:10 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:11 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.777s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:04:11 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-81ab8e01-af5c-4350-a197-73360b2eed76" returned: 0 in 0.943s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-81ab8e01-af5c-4350-a197-73360b2eed76 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:11 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Deleted volume successfully. Jul 01 04:04:11 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-81ab8e01-af5c-4350-a197-73360b2eed76 Jul 01 04:04:11 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8656b332-7fb4-492d-ad97-10b5b63c2bb7 tempest-VolumesGetTest-541378110 None] Lock "cinder-2113cbb9-b62f-4bd5-8995-d7fec87a11ec-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-235acb37-d604-4047-8010-f4c4ec4900cb-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Lock "cinder-235acb37-d604-4047-8010-f4c4ec4900cb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-quobyte-235acb37-d604-4047-8010-f4c4ec4900cb" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-235acb37-d604-4047-8010-f4c4ec4900cb" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75744d0-df1b-4190-81f9-fcb694684ae1]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-235acb37-d604-4047-8010-f4c4ec4900cb {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:11 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-235acb37-d604-4047-8010-f4c4ec4900cb Jul 01 04:04:11 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:11 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-81ab8e01-af5c-4350-a197-73360b2eed76" returned: 0 in 0.823s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Lock "cinder-quobyte-81ab8e01-af5c-4350-a197-73360b2eed76" released by "delete_volume" :: held 1.824s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Acquiring lock "cinder-quobyte-eeb55e61-3b09-48af-9850-9375b03b2ec5" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Lock "cinder-quobyte-eeb55e61-3b09-48af-9850-9375b03b2ec5" acquired by "delete_volume" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[518b63b1-fc46-4abd-9145-b2691d353960]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eeb55e61-3b09-48af-9850-9375b03b2ec5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:12 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eeb55e61-3b09-48af-9850-9375b03b2ec5 Jul 01 04:04:12 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:12 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-235acb37-d604-4047-8010-f4c4ec4900cb" returned: 0 in 0.979s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-235acb37-d604-4047-8010-f4c4ec4900cb {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:12 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-235acb37-d604-4047-8010-f4c4ec4900cb Jul 01 04:04:12 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:12 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eeb55e61-3b09-48af-9850-9375b03b2ec5" returned: 0 in 1.050s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eeb55e61-3b09-48af-9850-9375b03b2ec5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:13 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eeb55e61-3b09-48af-9850-9375b03b2ec5 Jul 01 04:04:13 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-235acb37-d604-4047-8010-f4c4ec4900cb" returned: 0 in 0.930s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:13 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-235acb37-d604-4047-8010-f4c4ec4900cb" released by "delete_volume" :: held 1.995s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:13 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Created reservations ['8c548b29-e636-4ac4-917d-84f96f58d81b', '596cee75-bdf1-40e6-bc5b-8c09bf24e9a4', 'b86ded4f-418e-4ecc-a5f8-21811527a8f1', '1a932433-1543-4be6-b2b6-e65ae1d59a05'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:04:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:13 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:04:13 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:14 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-eeb55e61-3b09-48af-9850-9375b03b2ec5" returned: 0 in 1.071s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:14 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Lock "cinder-quobyte-eeb55e61-3b09-48af-9850-9375b03b2ec5" released by "delete_volume" :: held 2.167s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:14 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Created reservations ['d302725d-258c-4e25-8cbc-8388c3a89fcc'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:04:14 devstack cinder-volume[86177]: WARNING cinder.quota [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1007968720 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1007968720, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:04:14 devstack cinder-volume[86177]: WARNING cinder.quota [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1007968720 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1007968720, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:04:14 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Created reservations ['5f1ec8be-6377-4731-b5db-e18f949b3480', '5ae7c02c-47da-46a0-8a5a-97880a4be6ce', '114f7b99-33c4-436b-9577-fda64c3a5cff', '0293fb42-b7d3-4bbb-a6b7-31ff1573ad1c'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:04:14 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Created reservations ['628b5e56-0642-42bd-9511-7a32f9c8ffc5', '97dc41c1-3775-4fe5-b32e-b9b19f7e1a10', '5265a83d-7a8c-4f58-a301-1abaccb7df1e', 'da735cd2-1054-4352-974d-532e7450359c'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:04:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:14 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:04:14 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:14 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.085s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:14 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:04:14 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Deleted volume successfully. Jul 01 04:04:14 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-55b4a546-1f58-4cd7-953a-f320414a37a0 tempest-VolumesGetTest-541378110 None] Lock "cinder-235acb37-d604-4047-8010-f4c4ec4900cb-delete_volume" released by "delete_volume" :: held 3.504s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Flow 'volume_create_manager' (1ea19a12-5802-4263-9bc6-e1860aab09fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfd87a5-28c3-4b5a-8fb4-20e5d200f731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfd87a5-28c3-4b5a-8fb4-20e5d200f731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-561215110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03590c6-bacb-4001-a9c5-afe82fe319b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e92dd14baeb47cb89d9679d0e234a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:15Z,use_quota=True,user_id='977ce7ae30cd48cd90c7d54694050280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c1071b-f72e-4e13-8e0a-3af4076e4b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c1071b-f72e-4e13-8e0a-3af4076e4b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcadf346-0880-4139-bf9a-33a170658e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcadf346-0880-4139-bf9a-33a170658e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03590c6-bacb-4001-a9c5-afe82fe319b0', 'volume_name': 'volume-a03590c6-bacb-4001-a9c5-afe82fe319b0', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aced8286-8d91-4310-84c3-d50b91561753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aced8286-8d91-4310-84c3-d50b91561753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71afc3ba-0a7b-4e4a-a8c1-3fe5f42fed85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:15 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Volume a03590c6-bacb-4001-a9c5-afe82fe319b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03590c6-bacb-4001-a9c5-afe82fe319b0', 'volume_size': 1} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-561215110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03590c6-bacb-4001-a9c5-afe82fe319b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e92dd14baeb47cb89d9679d0e234a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:15Z,use_quota=True,user_id='977ce7ae30cd48cd90c7d54694050280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Creating volume a03590c6-bacb-4001-a9c5-afe82fe319b0 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:04:15 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:04:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:15 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 1073741824 Jul 01 04:04:15 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:16 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.321s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:16 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:04:16 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8ea07768-83d0-4c2a-b8bd-5dae807e4ad9 tempest-GroupsTest-1937768813 None] Delete group completed successfully. Jul 01 04:04:16 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 1073741824" returned: 0 in 1.031s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:16 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 Jul 01 04:04:16 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:17 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0" returned: 0 in 0.905s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:04:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71afc3ba-0a7b-4e4a-a8c1-3fe5f42fed85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03590c6-bacb-4001-a9c5-afe82fe319b0', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b09661-b048-456b-b00d-3154d520a034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:17 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Volume volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 (a03590c6-bacb-4001-a9c5-afe82fe319b0): created successfully Jul 01 04:04:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b09661-b048-456b-b00d-3154d520a034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Flow 'volume_create_manager' (1ea19a12-5802-4263-9bc6-e1860aab09fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:17 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-2643b6f2-5336-43c3-92f3-21910833a957 tempest-VolumesGetTest-541378110 None] Created volume successfully. Jul 01 04:04:17 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-63c73c1b-38dd-47fa-9bd7-095eb9a09881 tempest-GroupSnapshotsTest-1531675490 None] Group tempest-GroupSnapshotsTest-Group-1631084045: creating Jul 01 04:04:17 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-63c73c1b-38dd-47fa-9bd7-095eb9a09881 tempest-GroupSnapshotsTest-1531675490 None] Group tempest-GroupSnapshotsTest-Group-1631084045: created successfully Jul 01 04:04:17 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-63c73c1b-38dd-47fa-9bd7-095eb9a09881 tempest-GroupSnapshotsTest-1531675490 None] Create group completed successfully. Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Flow 'volume_create_manager' (22c89d9b-8c52-4366-bb6e-162b636f12cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fb5aa2-76f4-4054-b5c4-bb3065dca67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fb5aa2-76f4-4054-b5c4-bb3065dca67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-147149058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ee42c2-d873-4e7f-8e43-a88aae1b2943,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4e92dd14baeb47cb89d9679d0e234a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a03590c6-bacb-4001-a9c5-afe82fe319b0,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:19Z,use_quota=True,user_id='977ce7ae30cd48cd90c7d54694050280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eeb226c-2d28-4772-be06-fe1a5a5ed83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eeb226c-2d28-4772-be06-fe1a5a5ed83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a528f91-38a6-488b-9793-4cfd357814e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a528f91-38a6-488b-9793-4cfd357814e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '22ee42c2-d873-4e7f-8e43-a88aae1b2943', 'volume_name': 'volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943', 'volume_size': 1, 'source_volid': 'a03590c6-bacb-4001-a9c5-afe82fe319b0', 'source_volstatus': 'available'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb754209-80cc-4086-84c8-ebb1bb56ba24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb754209-80cc-4086-84c8-ebb1bb56ba24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d28c9de-0b3f-45d0-8ecd-48452cc979a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:19 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Volume 22ee42c2-d873-4e7f-8e43-a88aae1b2943: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943', 'volume_size': 1, 'source_volid': 'a03590c6-bacb-4001-a9c5-afe82fe319b0', 'source_volstatus': 'available'} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:19 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Cloning volume a03590c6-bacb-4001-a9c5-afe82fe319b0 to volume 22ee42c2-d873-4e7f-8e43-a88aae1b2943 Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Creating offline snapshot ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 of volume a03590c6-bacb-4001-a9c5-afe82fe319b0 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Flow 'volume_create_manager' (1b73f85e-5e02-4ab0-b098-c2f2cc843e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca8e4c8-dc11-4bbc-b284-81b9802e6174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c5f835-0585-4fd7-9697-73f0fe123fd6]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca8e4c8-dc11-4bbc-b284-81b9802e6174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2033480083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17a35f24-96e4-4625-804b-11d5328f55f5,host='devstack@QuobyteHD#QuobyteHD',id=cd28831c-ad90-47f1-8c24-dcf54251ea9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b52083cce14b15924c6b9689c0e2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:20Z,use_quota=True,user_id='bbc93f964c82418cb0b09de5583e4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c91d010f-1abd-4c89-b85f-248c7be2e2bf),volume_type_id=c91d010f-1abd-4c89-b85f-248c7be2e2bf)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200b142a-3626-4535-9998-589e1dc2ab6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200b142a-3626-4535-9998-589e1dc2ab6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab2cdd7-f9e0-48e7-88f0-f9209e4746c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab2cdd7-f9e0-48e7-88f0-f9209e4746c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd28831c-ad90-47f1-8c24-dcf54251ea9c', 'volume_name': 'volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5bdbae8-525e-41a8-98ac-fa4a804bcb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5bdbae8-525e-41a8-98ac-fa4a804bcb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c4bee5-0208-42e0-a55b-995752d29ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:19 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Volume cd28831c-ad90-47f1-8c24-dcf54251ea9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c', 'volume_size': 1} Jul 01 04:04:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:19 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 Jul 01 04:04:19 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:20 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0" returned: 0 in 0.972s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:20 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 1G Jul 01 04:04:20 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:21 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-28501dca-646d-4866-9dac-bb796ef01d37 tempest-GroupsV320Test-1067126896 None] Group tempest-GroupsV320Test-Group-15341163: creating Jul 01 04:04:21 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-28501dca-646d-4866-9dac-bb796ef01d37 tempest-GroupsV320Test-1067126896 None] Group tempest-GroupsV320Test-Group-15341163: created successfully Jul 01 04:04:21 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-28501dca-646d-4866-9dac-bb796ef01d37 tempest-GroupsV320Test-1067126896 None] Create group completed successfully. Jul 01 04:04:22 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 1G" returned: 0 in 1.314s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:22 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 Jul 01 04:04:22 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:22 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069" returned: 0 in 0.772s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:22 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 is being set with open permissions: ugo+rw Jul 01 04:04:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:22 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 Jul 01 04:04:22 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:23 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069" returned: 0 in 0.804s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:23 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.info Jul 01 04:04:23 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:23 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-23c5b113-1ea4-4cee-be56-f69ba06b288c tempest-GroupsV320Test-1067126896 None] Created reservations ['ad142716-670d-4a2f-8a71-dd7e91194e63'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:04:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-23c5b113-1ea4-4cee-be56-f69ba06b288c tempest-GroupsV320Test-1067126896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-23c5b113-1ea4-4cee-be56-f69ba06b288c tempest-GroupsV320Test-1067126896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-23c5b113-1ea4-4cee-be56-f69ba06b288c tempest-GroupsV320Test-1067126896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-23c5b113-1ea4-4cee-be56-f69ba06b288c tempest-GroupsV320Test-1067126896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-23c5b113-1ea4-4cee-be56-f69ba06b288c tempest-GroupsV320Test-1067126896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-23c5b113-1ea4-4cee-be56-f69ba06b288c tempest-GroupsV320Test-1067126896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:23 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:04:23 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:24 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.info" returned: 0 in 0.835s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:24 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.info is being set with open permissions: ugo+rw Jul 01 04:04:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:04:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:24 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.info Jul 01 04:04:24 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:24 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:04:24 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:25 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-23c5b113-1ea4-4cee-be56-f69ba06b288c tempest-GroupsV320Test-1067126896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.234s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-23c5b113-1ea4-4cee-be56-f69ba06b288c tempest-GroupsV320Test-1067126896 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:04:25 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-23c5b113-1ea4-4cee-be56-f69ba06b288c tempest-GroupsV320Test-1067126896 None] Delete group completed successfully. Jul 01 04:04:25 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.info" returned: 0 in 1.105s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-quobyte-22ee42c2-d873-4e7f-8e43-a88aae1b2943" by "_copy_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-22ee42c2-d873-4e7f-8e43-a88aae1b2943" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] snapshot: ceccf6e6-b9fb-44e8-a0ac-d8b924faf069, volume: 22ee42c2-d873-4e7f-8e43-a88aae1b2943, {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 04:04:25 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.177s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 28 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7b4fe4-47e7-46b9-8713-8c2dda13cc60]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:25 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 Jul 01 04:04:25 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:26 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069" returned: 0 in 0.999s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a03590c6-bacb-4001-a9c5-afe82fe319b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:04:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 04:04:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Creating direct copy from snapshot {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 04:04:26 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c29dedf-0194-46a1-83b8-ac4057e0ecc4]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:26 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 Jul 01 04:04:26 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0" returned: 0 in 0.955s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:27 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:27 devstack cinder-volume[86177]: DEBUG cinder.utils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Path /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943 not found in is_blk_device check {{(pid=86177) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 04:04:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:27 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943 Jul 01 04:04:27 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:33 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=31,cinder:UPDATE=50,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:04:33 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=39,cinder:SELECT=48,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:04:34 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943" returned: 0 in 6.709s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:34 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[60456f7b-5e5b-4eb5-81cd-0e8da918bf19]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:34 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 Jul 01 04:04:34 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:35 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0" returned: 0 in 1.021s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:35 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Image conversion details: src /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0, size 1024.00 MB, duration 6.71 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:04:35 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Converted 1024.00 MB image at 152.60 MB/s Jul 01 04:04:35 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943 is being set with open permissions: ugo+rw Jul 01 04:04:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:35 devstack sudo[94000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943 Jul 01 04:04:35 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:36 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943" returned: 0 in 0.662s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:36 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-22ee42c2-d873-4e7f-8e43-a88aae1b2943" released by "_copy_volume_from_snapshot" :: held 10.489s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:36 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-quobyte-ceccf6e6-b9fb-44e8-a0ac-d8b924faf069" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:36 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-ceccf6e6-b9fb-44e8-a0ac-d8b924faf069" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Deleting offline snapshot ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 of volume a03590c6-bacb-4001-a9c5-afe82fe319b0 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:04:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] snapshot_file for this snap is: volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:04:36 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cda944-cf5c-4890-abff-217879be67a1]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:36 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 Jul 01 04:04:36 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:37 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069" returned: 0 in 0.800s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a03590c6-bacb-4001-a9c5-afe82fe319b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:04:37 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c448bd-451d-4a35-8a89-d34d499e502a]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:37 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 Jul 01 04:04:37 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:37 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0" returned: 0 in 0.805s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:37 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 Jul 01 04:04:37 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:38 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069" returned: 0 in 0.808s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:38 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069 Jul 01 04:04:38 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:39 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0.ceccf6e6-b9fb-44e8-a0ac-d8b924faf069" returned: 0 in 0.699s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-ceccf6e6-b9fb-44e8-a0ac-d8b924faf069" released by "_delete_snapshot" :: held 3.219s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.810s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.642s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17a35f24-96e4-4625-804b-11d5328f55f5,created_at=2026-07-01T02:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2033480083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17a35f24-96e4-4625-804b-11d5328f55f5,host='devstack@QuobyteHD#QuobyteHD',id=cd28831c-ad90-47f1-8c24-dcf54251ea9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b52083cce14b15924c6b9689c0e2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:20Z,use_quota=True,user_id='bbc93f964c82418cb0b09de5583e4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c91d010f-1abd-4c89-b85f-248c7be2e2bf),volume_type_id=c91d010f-1abd-4c89-b85f-248c7be2e2bf)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Creating volume cd28831c-ad90-47f1-8c24-dcf54251ea9c {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:04:39 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:39 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c 1073741824 Jul 01 04:04:39 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d28c9de-0b3f-45d0-8ecd-48452cc979a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943', 'volume_size': 1, 'source_volid': 'a03590c6-bacb-4001-a9c5-afe82fe319b0', 'source_volstatus': 'available'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1c7e6f-98d0-4657-be8a-395f91ade07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:39 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Volume volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943 (22ee42c2-d873-4e7f-8e43-a88aae1b2943): created successfully Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1c7e6f-98d0-4657-be8a-395f91ade07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Flow 'volume_create_manager' (22c89d9b-8c52-4366-bb6e-162b636f12cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:39 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-530cd95d-a81d-413f-9750-f16a9a236d53 tempest-VolumesGetTest-541378110 None] Created volume successfully. Jul 01 04:04:40 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c 1073741824" returned: 0 in 0.962s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:40 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c Jul 01 04:04:40 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:41 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c" returned: 0 in 0.728s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c4bee5-0208-42e0-a55b-995752d29ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d21282-5bc2-4ee4-b608-473340327cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:41 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Volume volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c (cd28831c-ad90-47f1-8c24-dcf54251ea9c): created successfully Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d21282-5bc2-4ee4-b608-473340327cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Flow 'volume_create_manager' (1b73f85e-5e02-4ab0-b098-c2f2cc843e67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:41 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-106d926d-f7a6-4a3c-8d56-967a307c4aea tempest-GroupSnapshotsTest-1531675490 None] Created volume successfully. Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Flow 'volume_create_manager' (f428e43a-eed7-4ba7-8d6c-26e30d41a0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1735d607-3b5e-45ca-a668-8d1eceea2c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1735d607-3b5e-45ca-a668-8d1eceea2c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-645542778',display_name='tempest-VolumesGetTest-Volume-166941842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c7e0a4-fb0b-4e39-869c-638085049a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e92dd14baeb47cb89d9679d0e234a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:41Z,use_quota=True,user_id='977ce7ae30cd48cd90c7d54694050280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0119d3c-5340-4749-b94c-486955d2731f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0119d3c-5340-4749-b94c-486955d2731f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370e8f3a-c468-4f18-ac52-dbb5c85f596b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370e8f3a-c468-4f18-ac52-dbb5c85f596b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28c7e0a4-fb0b-4e39-869c-638085049a7d', 'volume_name': 'volume-28c7e0a4-fb0b-4e39-869c-638085049a7d', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7234a5e-af03-4377-b807-8531129a2611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7234a5e-af03-4377-b807-8531129a2611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411a93a2-5a09-4a8f-8d31-361a91700ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:41 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Volume 28c7e0a4-fb0b-4e39-869c-638085049a7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28c7e0a4-fb0b-4e39-869c-638085049a7d', 'volume_size': 1} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-645542778',display_name='tempest-VolumesGetTest-Volume-166941842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c7e0a4-fb0b-4e39-869c-638085049a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e92dd14baeb47cb89d9679d0e234a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:41Z,use_quota=True,user_id='977ce7ae30cd48cd90c7d54694050280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Creating volume 28c7e0a4-fb0b-4e39-869c-638085049a7d {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:04:41 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:04:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28c7e0a4-fb0b-4e39-869c-638085049a7d 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:41 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28c7e0a4-fb0b-4e39-869c-638085049a7d 1073741824 Jul 01 04:04:41 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:42 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28c7e0a4-fb0b-4e39-869c-638085049a7d 1073741824" returned: 0 in 0.923s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28c7e0a4-fb0b-4e39-869c-638085049a7d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:42 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28c7e0a4-fb0b-4e39-869c-638085049a7d Jul 01 04:04:42 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:42 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] GroupSnapshot deb10c56-6e20-4ddd-ba19-0862088d4c4a: creating. Jul 01 04:04:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] Group snapshot deb10c56-6e20-4ddd-ba19-0862088d4c4a: creating. {{(pid=86177) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 01 04:04:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:43 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28c7e0a4-fb0b-4e39-869c-638085049a7d" returned: 0 in 0.791s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.409s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411a93a2-5a09-4a8f-8d31-361a91700ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c7e0a4-fb0b-4e39-869c-638085049a7d', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31118955-0d2e-4c48-87c7-bd4d20bbee93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] Creating offline snapshot bd6c17c1-27cc-4202-8386-85e3f35583d0 of volume cd28831c-ad90-47f1-8c24-dcf54251ea9c {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:04:43 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Volume volume-28c7e0a4-fb0b-4e39-869c-638085049a7d (28c7e0a4-fb0b-4e39-869c-638085049a7d): created successfully Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31118955-0d2e-4c48-87c7-bd4d20bbee93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Flow 'volume_create_manager' (f428e43a-eed7-4ba7-8d6c-26e30d41a0ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e493f1d-c7fc-47ec-be3f-f9c413e70219]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:43 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-4fb46759-f1ad-4617-a109-8578275bffdc tempest-VolumesGetTest-541378110 None] Created volume successfully. Jul 01 04:04:43 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c Jul 01 04:04:43 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Flow 'volume_create_manager' (34c0b10e-7583-4307-8688-cd183a5304b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2a9973-3b83-452e-b3cf-f18884b351b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-28c7e0a4-fb0b-4e39-869c-638085049a7d-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2a9973-3b83-452e-b3cf-f18884b351b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1604274139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ada45eb-6d51-4667-b402-963e7e2c37fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7983e82086214c7ca0469159e7fb2db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:44Z,use_quota=True,user_id='f8e61bbfec8a410a9756071463d59a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f241ba43-258c-4784-b9a5-4cc0ab365638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f241ba43-258c-4784-b9a5-4cc0ab365638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d5aed4-c402-4d05-b6fa-8ac421aff42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d5aed4-c402-4d05-b6fa-8ac421aff42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ada45eb-6d51-4667-b402-963e7e2c37fe', 'volume_name': 'volume-9ada45eb-6d51-4667-b402-963e7e2c37fe', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf021f9c-476d-4db6-8d2f-333b0e9b00a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf021f9c-476d-4db6-8d2f-333b0e9b00a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e40731-0385-4478-a8db-e0c848a147fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:43 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Volume 9ada45eb-6d51-4667-b402-963e7e2c37fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ada45eb-6d51-4667-b402-963e7e2c37fe', 'volume_size': 1} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Lock "cinder-28c7e0a4-fb0b-4e39-869c-638085049a7d-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-quobyte-28c7e0a4-fb0b-4e39-869c-638085049a7d" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-28c7e0a4-fb0b-4e39-869c-638085049a7d" acquired by "delete_volume" :: waited 0.015s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[87192e41-2236-4be1-8a13-f7eba59eb835]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28c7e0a4-fb0b-4e39-869c-638085049a7d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:44 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28c7e0a4-fb0b-4e39-869c-638085049a7d Jul 01 04:04:44 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:44 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c" returned: 0 in 0.848s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:44 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 1G Jul 01 04:04:44 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:44 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28c7e0a4-fb0b-4e39-869c-638085049a7d" returned: 0 in 0.808s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28c7e0a4-fb0b-4e39-869c-638085049a7d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:44 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28c7e0a4-fb0b-4e39-869c-638085049a7d Jul 01 04:04:44 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:45 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 1G" returned: 0 in 0.852s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:45 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 Jul 01 04:04:45 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:45 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28c7e0a4-fb0b-4e39-869c-638085049a7d" returned: 0 in 0.729s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-28c7e0a4-fb0b-4e39-869c-638085049a7d" released by "delete_volume" :: held 1.592s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:45 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Created reservations ['d65554e3-87bb-4d7c-83b2-5d9646e4d327', '1b97151c-93f1-4185-b99b-53d6c2ccb734', '6c02a272-e8db-4bb4-a08c-2ac27edd9f4e', '1a974164-1e38-4c83-84ff-ae0dff6bd360'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:04:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:45 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:45 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:45 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:04:45 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:45 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0" returned: 0 in 0.795s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:45 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 is being set with open permissions: ugo+rw: NotImplementedError Jul 01 04:04:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:45 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 Jul 01 04:04:45 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Flow 'volume_create_manager' (c399ca10-29b4-4ff9-b86e-884ae800f530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db2b292-c61b-43b1-b2a7-17157e80f65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db2b292-c61b-43b1-b2a7-17157e80f65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-214562475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118e04cd-7e8a-4edf-930d-12a485038f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63fe91280dd4f1f9dca098494a074f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:46Z,use_quota=True,user_id='3714d7b4ace44918b49d8667427293f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75563567-a3de-4f8b-95a1-96168f74bd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75563567-a3de-4f8b-95a1-96168f74bd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e920c6-2514-44cb-9aec-bc46f5ab3cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e920c6-2514-44cb-9aec-bc46f5ab3cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '118e04cd-7e8a-4edf-930d-12a485038f9d', 'volume_name': 'volume-118e04cd-7e8a-4edf-930d-12a485038f9d', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d104f116-e37d-4f31-9f18-fba03f8a2668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d104f116-e37d-4f31-9f18-fba03f8a2668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1103640a-3c45-403c-84b8-eb0c6e20d138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:46 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Volume 118e04cd-7e8a-4edf-930d-12a485038f9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-118e04cd-7e8a-4edf-930d-12a485038f9d', 'volume_size': 1} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-22ee42c2-d873-4e7f-8e43-a88aae1b2943-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Lock "cinder-22ee42c2-d873-4e7f-8e43-a88aae1b2943-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-quobyte-22ee42c2-d873-4e7f-8e43-a88aae1b2943" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-22ee42c2-d873-4e7f-8e43-a88aae1b2943" acquired by "delete_volume" :: waited 0.028s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe56a98-f7f1-479b-9c7f-f98d5c2fcc51]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:46 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943 Jul 01 04:04:46 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:46 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.785s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:04:46 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Deleted volume successfully. Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9b07740d-dd48-4a68-a45c-da5e5ef18044 tempest-VolumesGetTest-541378110 None] Lock "cinder-28c7e0a4-fb0b-4e39-869c-638085049a7d-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:46 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0" returned: 0 in 0.729s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:46 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.info Jul 01 04:04:46 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:47 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943" returned: 0 in 0.781s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:47 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943 Jul 01 04:04:47 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:47 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.info" returned: 0 in 0.658s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:47 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 01 04:04:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:47 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.info Jul 01 04:04:47 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:47 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-22ee42c2-d873-4e7f-8e43-a88aae1b2943" returned: 0 in 0.642s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:47 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-22ee42c2-d873-4e7f-8e43-a88aae1b2943" released by "delete_volume" :: held 1.472s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:47 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Created reservations ['c2126b29-cb16-458c-bddd-a4ad2e7c29cf', '8f826950-98f3-4e8d-afba-2b4ff3cdae93', 'e9ff897e-11b2-487b-9d52-f6cfa66015ea', '70360836-87d1-421b-809e-7b5c3d3fdf71'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:04:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:47 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:04:47 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:47 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.info" returned: 0 in 0.667s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.672s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.124s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1604274139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ada45eb-6d51-4667-b402-963e7e2c37fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7983e82086214c7ca0469159e7fb2db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:44Z,use_quota=True,user_id='f8e61bbfec8a410a9756071463d59a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Creating volume 9ada45eb-6d51-4667-b402-963e7e2c37fe {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:04:48 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9ada45eb-6d51-4667-b402-963e7e2c37fe 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:48 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9ada45eb-6d51-4667-b402-963e7e2c37fe 1073741824 Jul 01 04:04:48 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:48 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-3450e277-79d6-4f04-a972-5562a46cad6d tempest-GroupSnapshotsTest-1531675490 None] group_snapshot deb10c56-6e20-4ddd-ba19-0862088d4c4a: created successfully Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-a03590c6-bacb-4001-a9c5-afe82fe319b0-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Lock "cinder-a03590c6-bacb-4001-a9c5-afe82fe319b0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:48 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.687s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:04:48 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Deleted volume successfully. Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-quobyte-a03590c6-bacb-4001-a9c5-afe82fe319b0" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b67b541-6921-40e5-bdac-bff795c5e526 tempest-VolumesGetTest-541378110 None] Lock "cinder-22ee42c2-d873-4e7f-8e43-a88aae1b2943-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-a03590c6-bacb-4001-a9c5-afe82fe319b0" acquired by "delete_volume" :: waited 0.024s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6077c0da-4d63-4517-bda1-c21ba7ddbeb0]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:48 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 Jul 01 04:04:48 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:48 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9ada45eb-6d51-4667-b402-963e7e2c37fe 1073741824" returned: 0 in 0.867s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9ada45eb-6d51-4667-b402-963e7e2c37fe {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:48 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9ada45eb-6d51-4667-b402-963e7e2c37fe Jul 01 04:04:48 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:49 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0" returned: 0 in 0.851s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:49 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0 Jul 01 04:04:49 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:49 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9ada45eb-6d51-4667-b402-963e7e2c37fe" returned: 0 in 0.705s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.469s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-214562475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118e04cd-7e8a-4edf-930d-12a485038f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63fe91280dd4f1f9dca098494a074f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:46Z,use_quota=True,user_id='3714d7b4ace44918b49d8667427293f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Creating volume 118e04cd-7e8a-4edf-930d-12a485038f9d {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:04:49 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-118e04cd-7e8a-4edf-930d-12a485038f9d 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e40731-0385-4478-a8db-e0c848a147fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ada45eb-6d51-4667-b402-963e7e2c37fe', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:49 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-118e04cd-7e8a-4edf-930d-12a485038f9d 1073741824 Jul 01 04:04:49 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3860b542-4cc3-4f9d-86ff-df8f5f75fd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:49 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Volume volume-9ada45eb-6d51-4667-b402-963e7e2c37fe (9ada45eb-6d51-4667-b402-963e7e2c37fe): created successfully Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3860b542-4cc3-4f9d-86ff-df8f5f75fd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Flow 'volume_create_manager' (34c0b10e-7583-4307-8688-cd183a5304b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:49 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-53790db7-a1b1-4e5a-bc7a-6160893fe44c tempest-VolumeQuotasAdminTestJSON-1923945365 None] Created volume successfully. Jul 01 04:04:50 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a03590c6-bacb-4001-a9c5-afe82fe319b0" returned: 0 in 0.672s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-a03590c6-bacb-4001-a9c5-afe82fe319b0" released by "delete_volume" :: held 1.597s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Created reservations ['d8af65b9-a8a4-4526-a565-c743acfdae42', '921c5649-9754-43a4-8468-f8216579b81b', '56977cc4-84d1-4872-843c-d22140cf6b7c', 'c5a16bd2-09de-4248-889f-8368d23abd16'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Acquiring lock "cinder-9ada45eb-6d51-4667-b402-963e7e2c37fe-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Lock "cinder-9ada45eb-6d51-4667-b402-963e7e2c37fe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Acquiring lock "cinder-quobyte-9ada45eb-6d51-4667-b402-963e7e2c37fe" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Lock "cinder-quobyte-9ada45eb-6d51-4667-b402-963e7e2c37fe" acquired by "delete_volume" :: waited 0.038s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:50 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:04:50 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ad77bd-ddf8-4008-907d-56055b1fb0ce]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9ada45eb-6d51-4667-b402-963e7e2c37fe {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:50 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9ada45eb-6d51-4667-b402-963e7e2c37fe Jul 01 04:04:50 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:50 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-118e04cd-7e8a-4edf-930d-12a485038f9d 1073741824" returned: 0 in 0.939s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-118e04cd-7e8a-4edf-930d-12a485038f9d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:50 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-118e04cd-7e8a-4edf-930d-12a485038f9d Jul 01 04:04:50 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:51 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.745s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:04:51 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Deleted volume successfully. Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b3ba5d26-bbdd-460d-a22e-2493865d83a6 tempest-VolumesGetTest-541378110 None] Lock "cinder-a03590c6-bacb-4001-a9c5-afe82fe319b0-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:51 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9ada45eb-6d51-4667-b402-963e7e2c37fe" returned: 0 in 0.892s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9ada45eb-6d51-4667-b402-963e7e2c37fe {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:51 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9ada45eb-6d51-4667-b402-963e7e2c37fe Jul 01 04:04:51 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:51 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-118e04cd-7e8a-4edf-930d-12a485038f9d" returned: 0 in 0.748s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.081s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "cinder-quobyte-bd6c17c1-27cc-4202-8386-85e3f35583d0-534a360a-e894-416d-95eb-0c1f2f769836" by "_create_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1103640a-3c45-403c-84b8-eb0c6e20d138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-118e04cd-7e8a-4edf-930d-12a485038f9d', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50f333f-4618-4b2e-84b8-9cce4c3c9f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-bd6c17c1-27cc-4202-8386-85e3f35583d0-534a360a-e894-416d-95eb-0c1f2f769836" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Creating volume 534a360a-e894-416d-95eb-0c1f2f769836 from snapshot bd6c17c1-27cc-4202-8386-85e3f35583d0 {{(pid=86177) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "cinder-quobyte-534a360a-e894-416d-95eb-0c1f2f769836" by "_copy_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:04:51 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Volume volume-118e04cd-7e8a-4edf-930d-12a485038f9d (118e04cd-7e8a-4edf-930d-12a485038f9d): created successfully Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50f333f-4618-4b2e-84b8-9cce4c3c9f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Flow 'volume_create_manager' (c399ca10-29b4-4ff9-b86e-884ae800f530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-534a360a-e894-416d-95eb-0c1f2f769836" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] snapshot: bd6c17c1-27cc-4202-8386-85e3f35583d0, volume: 534a360a-e894-416d-95eb-0c1f2f769836, {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 04:04:51 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-11e91b54-923f-4790-b00d-9477f8b974a7 tempest-AttachVolumeNegativeTest-962019476 None] Created volume successfully. Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7503641e-d1f7-410a-9fed-4411dfc5c44c]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:51 devstack sudo[94126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 Jul 01 04:04:51 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Flow 'volume_create_manager' (4b29c22f-4f7f-4975-9d47-21f84fffe123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7b44d8-5f49-4cc2-90f1-a6a7ca836412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7b44d8-5f49-4cc2-90f1-a6a7ca836412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-986196218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194076a9-eda8-4530-86a3-d82dd45fab47,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4e92dd14baeb47cb89d9679d0e234a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:52Z,use_quota=True,user_id='977ce7ae30cd48cd90c7d54694050280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af19431-0a6a-4e84-a995-bb938190c6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af19431-0a6a-4e84-a995-bb938190c6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc48301-5c48-474e-8f17-11dd8e4ecf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.image.glance [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Creating Keystone auth plugin from conf {{(pid=86177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 04:04:52 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9ada45eb-6d51-4667-b402-963e7e2c37fe" returned: 0 in 0.765s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Lock "cinder-quobyte-9ada45eb-6d51-4667-b402-963e7e2c37fe" released by "delete_volume" :: held 1.706s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Created reservations ['8df326aa-5dad-4ec8-86a7-1674f966f128', '27cadb51-91ba-4026-8213-36b428ac08eb', '81b5d721-52d8-42a1-a738-ec0a9d7a9d25', 'd022f84f-6f00-404b-a4de-48364a4c667d'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:52 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:04:52 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc48301-5c48-474e-8f17-11dd8e4ecf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '194076a9-eda8-4530-86a3-d82dd45fab47', 'volume_name': 'volume-194076a9-eda8-4530-86a3-d82dd45fab47', 'volume_size': 1, 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43baa4017014b09a384294975690a79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'created_at': datetime.datetime(2026, 7, 1, 1, 52, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 1, 52, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7f171f-a417-4a6c-8cbe-7c5493df191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7f171f-a417-4a6c-8cbe-7c5493df191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555b6967-9fb0-4f80-a308-67ec28772660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:52 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Volume 194076a9-eda8-4530-86a3-d82dd45fab47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-194076a9-eda8-4530-86a3-d82dd45fab47', 'volume_size': 1, 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43baa4017014b09a384294975690a79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'created_at': datetime.datetime(2026, 7, 1, 1, 52, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 1, 52, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Trying to clone 194076a9-eda8-4530-86a3-d82dd45fab47 from image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 at location (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]). {{(pid=86177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 04:04:52 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0" returned: 0 in 1.005s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Creating direct copy from snapshot {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2b318a-bdf1-41ae-8d5b-1f2b8b1a4ca5]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:52 devstack sudo[94139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c Jul 01 04:04:52 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gf6_pub_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 04:04:52 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Image download 20.69 MB at 20.69 MB/s Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16bc2e1-9392-4111-8d72-54ba159280f3]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gf6_pub_devstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:53 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gf6_pub_devstack@QuobyteHD Jul 01 04:04:53 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:53 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.919s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:04:53 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Deleted volume successfully. Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b483282-5a50-47bb-9796-5eba15f13fac tempest-VolumeQuotasAdminTestJSON-1923945365 None] Lock "cinder-9ada45eb-6d51-4667-b402-963e7e2c37fe-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Flow 'volume_create_manager' (e217f98a-5e1d-4641-85ec-5d2c6cfe14c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679dcac7-31a5-489c-a8fe-37cacb5d27fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679dcac7-31a5-489c-a8fe-37cacb5d27fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1257065037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7cdb95c-e2d8-4998-9e70-7cef156a1f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7983e82086214c7ca0469159e7fb2db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:53Z,use_quota=True,user_id='f8e61bbfec8a410a9756071463d59a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bab8748-1db6-488e-a906-b877c2e8c206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bab8748-1db6-488e-a906-b877c2e8c206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de6d3cf-f0ad-4e34-b2c2-e16aa25139bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de6d3cf-f0ad-4e34-b2c2-e16aa25139bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7cdb95c-e2d8-4998-9e70-7cef156a1f80', 'volume_name': 'volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052aee5c-dbbd-40c0-9006-32fba48d47e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052aee5c-dbbd-40c0-9006-32fba48d47e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339d22a4-db6b-4490-ac14-b38bd4805e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:04:53 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Volume d7cdb95c-e2d8-4998-9e70-7cef156a1f80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80', 'volume_size': 1} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:53 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c" returned: 0 in 0.945s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG cinder.utils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Path /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-534a360a-e894-416d-95eb-0c1f2f769836 not found in is_blk_device check {{(pid=86177) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-534a360a-e894-416d-95eb-0c1f2f769836 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:53 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-534a360a-e894-416d-95eb-0c1f2f769836 Jul 01 04:04:53 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:53 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gf6_pub_devstack@QuobyteHD" returned: 0 in 0.887s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Temporary image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 is fetched for user 977ce7ae30cd48cd90c7d54694050280. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ccedc0-877f-488f-8bfe-487ed63610ee]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gf6_pub_devstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:53 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gf6_pub_devstack@QuobyteHD Jul 01 04:04:53 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:54 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gf6_pub_devstack@QuobyteHD" returned: 0 in 0.878s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-ba8aa78b-8e40-4313-899d-97592f76de0e req-11ad1e38-90d4-48be-8db5-76860641a67c tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:04:58 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-534a360a-e894-416d-95eb-0c1f2f769836" returned: 0 in 5.294s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:58 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2442804-5378-4463-be1e-93bb7e3d33b7]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:04:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:58 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c Jul 01 04:04:58 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:04:59 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Jul 01 04:04:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c" returned: 0 in 0.927s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:04:59 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Image conversion details: src /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-534a360a-e894-416d-95eb-0c1f2f769836 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:04:59 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Converted 1024.00 MB image at 193.38 MB/s Jul 01 04:04:59 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-534a360a-e894-416d-95eb-0c1f2f769836 is being set with open permissions: ugo+rw: NotImplementedError Jul 01 04:04:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-534a360a-e894-416d-95eb-0c1f2f769836 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:04:59 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-534a360a-e894-416d-95eb-0c1f2f769836 Jul 01 04:04:59 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:00 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-534a360a-e894-416d-95eb-0c1f2f769836" returned: 0 in 0.653s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-534a360a-e894-416d-95eb-0c1f2f769836" released by "_copy_volume_from_snapshot" :: held 8.987s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-bd6c17c1-27cc-4202-8386-85e3f35583d0-534a360a-e894-416d-95eb-0c1f2f769836" released by "_create_volume_from_snapshot" :: held 9.045s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.083s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.932s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1257065037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7cdb95c-e2d8-4998-9e70-7cef156a1f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7983e82086214c7ca0469159e7fb2db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:53Z,use_quota=True,user_id='f8e61bbfec8a410a9756071463d59a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:05:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Creating volume d7cdb95c-e2d8-4998-9e70-7cef156a1f80 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:05:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:05:00 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:05:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:00 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80 1073741824 Jul 01 04:05:00 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:00 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-ef252e9e-4ae4-40a3-b1d6-27c5da5d6aff tempest-GroupSnapshotsTest-1531675490 None] Create group from source-snapshot-deb10c56-6e20-4ddd-ba19-0862088d4c4a completed successfully. Jul 01 04:05:01 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80 1073741824" returned: 0 in 0.828s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:01 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80 Jul 01 04:05:01 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "cinder-quobyte-534a360a-e894-416d-95eb-0c1f2f769836" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-534a360a-e894-416d-95eb-0c1f2f769836" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:01 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6259729-5705-471c-8623-f59d54719fb0]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-534a360a-e894-416d-95eb-0c1f2f769836 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:01 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-534a360a-e894-416d-95eb-0c1f2f769836 Jul 01 04:05:01 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:02 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80" returned: 0 in 0.657s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.285s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-986196218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194076a9-eda8-4530-86a3-d82dd45fab47,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4e92dd14baeb47cb89d9679d0e234a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:04:52Z,use_quota=True,user_id='977ce7ae30cd48cd90c7d54694050280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Creating volume 194076a9-eda8-4530-86a3-d82dd45fab47 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:05:02 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:02 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 1073741824 Jul 01 04:05:02 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339d22a4-db6b-4490-ac14-b38bd4805e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc0a2bf-1774-4ea9-85cc-a3b2fd199bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:02 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Volume volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80 (d7cdb95c-e2d8-4998-9e70-7cef156a1f80): created successfully Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc0a2bf-1774-4ea9-85cc-a3b2fd199bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Flow 'volume_create_manager' (e217f98a-5e1d-4641-85ec-5d2c6cfe14c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:05:02 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-df53c9b1-40ec-4371-af88-2011fda2f6a6 tempest-VolumeQuotasAdminTestJSON-1923945365 None] Created volume successfully. Jul 01 04:05:02 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-534a360a-e894-416d-95eb-0c1f2f769836" returned: 0 in 0.887s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-534a360a-e894-416d-95eb-0c1f2f769836 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:02 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-534a360a-e894-416d-95eb-0c1f2f769836 Jul 01 04:05:02 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:02 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 1073741824" returned: 0 in 0.929s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:03 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-4544d493-09bc-4526-8b21-f6ecbd12550f tempest-VolumeQuotasAdminTestJSON-1573410284 None] Transfer volume completed successfully. Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:03 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 Jul 01 04:05:03 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:03 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-534a360a-e894-416d-95eb-0c1f2f769836" returned: 0 in 0.744s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-534a360a-e894-416d-95eb-0c1f2f769836" released by "delete_volume" :: held 1.670s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Created reservations ['846a38f6-03ed-47d5-be52-252d6a09474a'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:03 devstack cinder-volume[86177]: WARNING cinder.quota [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-427225423 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-427225423, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:05:03 devstack cinder-volume[86177]: WARNING cinder.quota [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-427225423 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-427225423, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Created reservations ['5463d805-c130-4f77-8b21-14597497cad9', '33c91487-6ad8-4a86-96f5-46156086f745', '094b39b6-9948-4fe3-b9d7-eba315ff5d13', '86a4649e-1350-4691-b3ce-3b80ef061c76'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:03 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:05:03 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:03 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47" returned: 0 in 0.726s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-ba8aa78b-8e40-4313-899d-97592f76de0e req-11ad1e38-90d4-48be-8db5-76860641a67c tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.090s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1932e3-b724-4fa3-ae1d-99949565711a]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-ba8aa78b-8e40-4313-899d-97592f76de0e req-11ad1e38-90d4-48be-8db5-76860641a67c tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-118e04cd-7e8a-4edf-930d-12a485038f9d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Attempting download of 44c37c3e-a2cd-450f-a8e6-b9270ee06395 ((None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}])) to volume 194076a9-eda8-4530-86a3-d82dd45fab47. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 04:05:03 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-118e04cd-7e8a-4edf-930d-12a485038f9d Jul 01 04:05:03 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a5a673-d93f-4b3c-813d-c9d6272d6049]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_tkbh9_5m {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:04 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] group_snapshot deb10c56-6e20-4ddd-ba19-0862088d4c4a: deleting Jul 01 04:05:04 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_tkbh9_5m Jul 01 04:05:04 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] group_snapshot deb10c56-6e20-4ddd-ba19-0862088d4c4a: deleting {{(pid=86177) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "cinder-quobyte-cd28831c-ad90-47f1-8c24-dcf54251ea9c" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-cd28831c-ad90-47f1-8c24-dcf54251ea9c" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "cinder-quobyte-bd6c17c1-27cc-4202-8386-85e3f35583d0" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-bd6c17c1-27cc-4202-8386-85e3f35583d0" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] Deleting offline snapshot bd6c17c1-27cc-4202-8386-85e3f35583d0 of volume cd28831c-ad90-47f1-8c24-dcf54251ea9c {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] snapshot_file for this snap is: volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[747ed6e4-57dc-469c-89b4-335c8e1cd2c1]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:04 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.142s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:05:04 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-23fbff98-2531-41e7-b2b2-18791f827a57 tempest-GroupSnapshotsTest-1531675490 None] Delete group completed successfully. Jul 01 04:05:04 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 Jul 01 04:05:04 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Acquiring lock "cinder-d7cdb95c-e2d8-4998-9e70-7cef156a1f80-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Lock "cinder-d7cdb95c-e2d8-4998-9e70-7cef156a1f80-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Acquiring lock "cinder-quobyte-d7cdb95c-e2d8-4998-9e70-7cef156a1f80" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Lock "cinder-quobyte-d7cdb95c-e2d8-4998-9e70-7cef156a1f80" acquired by "delete_volume" :: waited 0.028s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a801645-4dec-4e81-be69-03c537d43f10]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:05 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80 Jul 01 04:05:05 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:05 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-ba8aa78b-8e40-4313-899d-97592f76de0e req-11ad1e38-90d4-48be-8db5-76860641a67c tempest-AttachVolumeNegativeTest-962019476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-118e04cd-7e8a-4edf-930d-12a485038f9d" returned: 0 in 1.395s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-ba8aa78b-8e40-4313-899d-97592f76de0e req-11ad1e38-90d4-48be-8db5-76860641a67c tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.432s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:05 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-ba8aa78b-8e40-4313-899d-97592f76de0e req-11ad1e38-90d4-48be-8db5-76860641a67c tempest-AttachVolumeNegativeTest-962019476 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-118e04cd-7e8a-4edf-930d-12a485038f9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b4bd336-89c1-4550-ac63-1aedbd5ecdd8', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:05:05 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-ba8aa78b-8e40-4313-899d-97592f76de0e req-11ad1e38-90d4-48be-8db5-76860641a67c tempest-AttachVolumeNegativeTest-962019476 None] attachment_update completed successfully. Jul 01 04:05:05 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_tkbh9_5m" returned: 0 in 1.466s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_tkbh9_5m {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:05 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_tkbh9_5m Jul 01 04:05:05 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:05 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0" returned: 0 in 1.238s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:05:05 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af1783-271e-4675-8f62-d583b84b618b]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:05 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c Jul 01 04:05:05 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:05 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80" returned: 0 in 1.042s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:05 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80 Jul 01 04:05:05 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:06 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_tkbh9_5m" returned: 1 in 0.912s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_tkbh9_5m' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:05:06 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c48346-9288-41ce-bafd-d8ff0da61650]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gf6_pub_devstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:06 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gf6_pub_devstack@QuobyteHD Jul 01 04:05:06 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:06 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c" returned: 0 in 0.901s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:06 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 Jul 01 04:05:06 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:06 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7cdb95c-e2d8-4998-9e70-7cef156a1f80" returned: 0 in 0.726s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Lock "cinder-quobyte-d7cdb95c-e2d8-4998-9e70-7cef156a1f80" released by "delete_volume" :: held 1.845s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:06 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Created reservations ['7d97184a-7718-47d9-8baf-7add53e43747', '4535a592-8440-4e97-94c6-568fa13efa34', '0595fada-eb5e-4475-b2c7-5d7a228202ab', 'd94ce9f2-04dc-4fa8-bc50-7f6ea2f08ac3'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:06 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:05:06 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:07 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gf6_pub_devstack@QuobyteHD" returned: 0 in 0.885s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:07 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] 44c37c3e-a2cd-450f-a8e6-b9270ee06395 was qcow2, converting to raw {{(pid=86177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 04:05:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gf6_pub_devstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:07 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gf6_pub_devstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 Jul 01 04:05:07 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:07 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0" returned: 0 in 0.908s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:07 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0 Jul 01 04:05:07 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:07 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.758s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:07 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:05:07 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Deleted volume successfully. Jul 01 04:05:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2340ad90-9ab1-49ed-957d-2cfd97fb6ead tempest-VolumeQuotasAdminTestJSON-1893312422 None] Lock "cinder-d7cdb95c-e2d8-4998-9e70-7cef156a1f80-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:08 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c.bd6c17c1-27cc-4202-8386-85e3f35583d0" returned: 0 in 0.776s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:08 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-bd6c17c1-27cc-4202-8386-85e3f35583d0" released by "_delete_snapshot" :: held 4.004s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:08 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-cd28831c-ad90-47f1-8c24-dcf54251ea9c" released by "delete_snapshot" :: held 4.042s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:08 devstack cinder-volume[86177]: WARNING cinder.quota [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-427225423 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-427225423, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:05:08 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] Created reservations ['a0958287-7d00-4bc2-903f-5b37c2e8b08e', '57fdab76-99eb-48ca-88d4-182c584cdb04', '777a41f4-5308-433a-87e8-983616af3ee2', '0b7c7dba-7de7-41b5-8293-25a030c451e5'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:08 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f5fdb739-c72c-4240-afcf-205f3fbd66bd tempest-GroupSnapshotsTest-1531675490 None] group_snapshot deb10c56-6e20-4ddd-ba19-0862088d4c4a: deleted successfully Jul 01 04:05:09 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gf6_pub_devstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47" returned: 0 in 2.367s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:09 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gf6_pub_devstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:05:09 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Converted 112.00 MB image at 47.20 MB/s Jul 01 04:05:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:09 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 1G Jul 01 04:05:09 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "cinder-quobyte-cd28831c-ad90-47f1-8c24-dcf54251ea9c" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-cd28831c-ad90-47f1-8c24-dcf54251ea9c" acquired by "delete_volume" :: waited 0.028s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:09 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[095298f0-2121-4c22-a1ad-a84c375b6e60]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:09 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c Jul 01 04:05:09 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:10 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 1G" returned: 0 in 1.122s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:10 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d268a1-2a95-45a5-8146-c269ff7eef97]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:10 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c" returned: 0 in 1.019s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:10 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c Jul 01 04:05:10 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:10 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 Jul 01 04:05:10 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:11 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cd28831c-ad90-47f1-8c24-dcf54251ea9c" returned: 0 in 0.836s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-cd28831c-ad90-47f1-8c24-dcf54251ea9c" released by "delete_volume" :: held 1.960s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:11 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Created reservations ['bd4f2eaf-a87c-4d98-8ceb-411abc147786'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:11 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47" returned: 0 in 0.999s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:11 devstack cinder-volume[86177]: WARNING cinder.db.api [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-427225423'] Jul 01 04:05:11 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Created reservations ['7a68e714-1383-4339-9e64-da3acce6f3f6', 'bed36651-e495-4278-ac2b-b0b930e6cbd4', 'b048382e-24fe-487d-942a-f3471690f32d', '6b243911-875f-47a5-8fc2-8cc1120e8f98'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:11 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 Jul 01 04:05:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:11 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:11 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:05:11 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:12 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.979s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:12 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:05:12 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-4d13fb68-5579-4b9d-a9bf-f5134dfe15d5 tempest-GroupSnapshotsTest-1531675490 None] Group tempest-GroupSnapshotsTest-Group-1983480253: creating Jul 01 04:05:12 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8f2e8fcf-dc89-4a2c-be8c-e6a595436a37 tempest-GroupSnapshotsTest-1531675490 None] Delete group completed successfully. Jul 01 04:05:12 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-4d13fb68-5579-4b9d-a9bf-f5134dfe15d5 tempest-GroupSnapshotsTest-1531675490 None] Group tempest-GroupSnapshotsTest-Group-1983480253: created successfully Jul 01 04:05:12 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:12 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-4d13fb68-5579-4b9d-a9bf-f5134dfe15d5 tempest-GroupSnapshotsTest-1531675490 None] Create group completed successfully. Jul 01 04:05:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47" returned: 1 in 1.202s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:05:12 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Downloaded image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 ((None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}])) to volume 194076a9-eda8-4530-86a3-d82dd45fab47 successfully. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 04:05:13 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Temporary image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 for user 977ce7ae30cd48cd90c7d54694050280 is deleted. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 04:05:13 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Marking volume 194076a9-eda8-4530-86a3-d82dd45fab47 as bootable. {{(pid=86177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 04:05:13 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Copying metadata from image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 to 194076a9-eda8-4530-86a3-d82dd45fab47. {{(pid=86177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 04:05:13 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Creating volume glance metadata for volume 194076a9-eda8-4530-86a3-d82dd45fab47 backed by image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 04:05:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555b6967-9fb0-4f80-a308-67ec28772660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194076a9-eda8-4530-86a3-d82dd45fab47', 'volume_size': 1, 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43baa4017014b09a384294975690a79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'created_at': datetime.datetime(2026, 7, 1, 1, 52, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 1, 52, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ff7bc8-1999-4424-a5b8-8a6fb6eadc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:13 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Volume volume-194076a9-eda8-4530-86a3-d82dd45fab47 (194076a9-eda8-4530-86a3-d82dd45fab47): created successfully Jul 01 04:05:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ff7bc8-1999-4424-a5b8-8a6fb6eadc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Flow 'volume_create_manager' (4b29c22f-4f7f-4975-9d47-21f84fffe123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:05:13 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c84047db-3375-4143-9e40-d18c00b23e9a tempest-VolumesGetTest-541378110 None] Created volume successfully. Jul 01 04:05:14 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:05:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Flow 'volume_create_manager' (e8cdd9e3-aa5a-4aeb-8121-e44ebeb354b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:05:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b9f871-8c0a-48cd-83d5-da30813a2bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b9f871-8c0a-48cd-83d5-da30813a2bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596780458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b8d9d12-ea64-4590-aa5b-3ead94f891bf,host='devstack@QuobyteHD#QuobyteHD',id=9f545123-170c-4ed3-af70-3ebe124de5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b52083cce14b15924c6b9689c0e2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:05:15Z,use_quota=True,user_id='bbc93f964c82418cb0b09de5583e4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27394b81-a351-4fe6-b932-1e9d61408153),volume_type_id=27394b81-a351-4fe6-b932-1e9d61408153)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038d81d1-4e24-476b-9df7-c4ef279a2c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038d81d1-4e24-476b-9df7-c4ef279a2c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132439b9-a2b9-436e-9ac0-30cfa3f83273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132439b9-a2b9-436e-9ac0-30cfa3f83273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f545123-170c-4ed3-af70-3ebe124de5d2', 'volume_name': 'volume-9f545123-170c-4ed3-af70-3ebe124de5d2', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae922ce-9405-47f3-91f3-9a1e11a7fb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae922ce-9405-47f3-91f3-9a1e11a7fb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09887ffb-3dd3-43fa-8ba8-e8fa30284ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:15 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Volume 9f545123-170c-4ed3-af70-3ebe124de5d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f545123-170c-4ed3-af70-3ebe124de5d2', 'volume_size': 1} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b8d9d12-ea64-4590-aa5b-3ead94f891bf,created_at=2026-07-01T02:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596780458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b8d9d12-ea64-4590-aa5b-3ead94f891bf,host='devstack@QuobyteHD#QuobyteHD',id=9f545123-170c-4ed3-af70-3ebe124de5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b52083cce14b15924c6b9689c0e2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:05:15Z,use_quota=True,user_id='bbc93f964c82418cb0b09de5583e4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27394b81-a351-4fe6-b932-1e9d61408153),volume_type_id=27394b81-a351-4fe6-b932-1e9d61408153)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Creating volume 9f545123-170c-4ed3-af70-3ebe124de5d2 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:05:15 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:15 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2 1073741824 Jul 01 04:05:15 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Flow 'volume_create_manager' (827d7514-1932-4a0a-8256-04eb18b35f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19fcba8-9621-450e-a6d4-1f1f36a03703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19fcba8-9621-450e-a6d4-1f1f36a03703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:05:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-136115097',display_name='tempest-VolumesGetTest-Volume-539701314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0ec8a1-6062-4bfe-82db-c40e6f16e18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e92dd14baeb47cb89d9679d0e234a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:05:15Z,use_quota=True,user_id='977ce7ae30cd48cd90c7d54694050280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d395ab2-66fb-41ba-a740-4f7821513257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d395ab2-66fb-41ba-a740-4f7821513257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b32fbd1-1cfc-4a00-a97a-ba8f20134a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b32fbd1-1cfc-4a00-a97a-ba8f20134a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db0ec8a1-6062-4bfe-82db-c40e6f16e18c', 'volume_name': 'volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24af306a-9d0d-4542-9625-ac556a51afa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24af306a-9d0d-4542-9625-ac556a51afa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7e1219-85b5-49c8-988b-965fbcc2be43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:15 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Volume db0ec8a1-6062-4bfe-82db-c40e6f16e18c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c', 'volume_size': 1} Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:15 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2 1073741824" returned: 0 in 0.955s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:16 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2 Jul 01 04:05:16 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Flow 'volume_create_manager' (ee2aab84-1c0f-4da0-9251-307dee38e23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229b8d49-18c5-4a09-a64b-b24a0ebb233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229b8d49-18c5-4a09-a64b-b24a0ebb233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1379284917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2885f493-6774-4c8a-b3d2-05aacd519e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44cd5636d3d24c52b6a5259189adc03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:05:16Z,use_quota=True,user_id='0c9f6d6595244aa4a89ec232cb81e13a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed66720-2e2d-43fa-97ad-519e5bd07ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed66720-2e2d-43fa-97ad-519e5bd07ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6432c262-235e-4806-b89e-36e40cf7f5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6432c262-235e-4806-b89e-36e40cf7f5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2885f493-6774-4c8a-b3d2-05aacd519e40', 'volume_name': 'volume-2885f493-6774-4c8a-b3d2-05aacd519e40', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c858d06-c761-4704-bf71-1f0cf6b3e40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c858d06-c761-4704-bf71-1f0cf6b3e40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52a0c59-bcb6-4e05-9147-9154763e8d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:16 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Volume 2885f493-6774-4c8a-b3d2-05aacd519e40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2885f493-6774-4c8a-b3d2-05aacd519e40', 'volume_size': 1} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:16 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2" returned: 0 in 0.680s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.421s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:05:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-136115097',display_name='tempest-VolumesGetTest-Volume-539701314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0ec8a1-6062-4bfe-82db-c40e6f16e18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e92dd14baeb47cb89d9679d0e234a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:05:15Z,use_quota=True,user_id='977ce7ae30cd48cd90c7d54694050280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Creating volume db0ec8a1-6062-4bfe-82db-c40e6f16e18c {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:05:16 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:16 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c 1073741824 Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09887ffb-3dd3-43fa-8ba8-e8fa30284ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f545123-170c-4ed3-af70-3ebe124de5d2', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:16 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157223c1-b1c2-494c-9dbf-9c915c49a017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:16 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Volume volume-9f545123-170c-4ed3-af70-3ebe124de5d2 (9f545123-170c-4ed3-af70-3ebe124de5d2): created successfully Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157223c1-b1c2-494c-9dbf-9c915c49a017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Flow 'volume_create_manager' (e8cdd9e3-aa5a-4aeb-8121-e44ebeb354b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:05:16 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0107332f-c274-419b-a078-dea5e14eb2fb tempest-GroupSnapshotsTest-1531675490 None] Created volume successfully. Jul 01 04:05:17 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c 1073741824" returned: 0 in 0.909s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:17 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c Jul 01 04:05:17 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:17 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:05:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Flow 'volume_create_manager' (57af3713-08bb-4fc1-aaea-98b4176d826c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:05:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce04fa4b-4d42-42c4-9835-f47f6f7e4f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce04fa4b-4d42-42c4-9835-f47f6f7e4f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-435178845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b8d9d12-ea64-4590-aa5b-3ead94f891bf,host='devstack@QuobyteHD#QuobyteHD',id=c5284b23-089e-4e4b-91dc-fbbdd9351bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b52083cce14b15924c6b9689c0e2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:05:18Z,use_quota=True,user_id='bbc93f964c82418cb0b09de5583e4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27394b81-a351-4fe6-b932-1e9d61408153),volume_type_id=27394b81-a351-4fe6-b932-1e9d61408153)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4446f220-d03b-4465-80ac-d2e163f1b793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4446f220-d03b-4465-80ac-d2e163f1b793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da760cd-dc81-4ca7-8c29-dc1191a8a3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da760cd-dc81-4ca7-8c29-dc1191a8a3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5284b23-089e-4e4b-91dc-fbbdd9351bf2', 'volume_name': 'volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4eb806-1cd0-4f9d-b296-e28a82185ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4eb806-1cd0-4f9d-b296-e28a82185ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8922276a-4b88-4578-afdf-325e19d441a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:17 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Volume c5284b23-089e-4e4b-91dc-fbbdd9351bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2', 'volume_size': 1} Jul 01 04:05:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:18 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c" returned: 0 in 0.685s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.018s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1379284917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2885f493-6774-4c8a-b3d2-05aacd519e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44cd5636d3d24c52b6a5259189adc03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:05:16Z,use_quota=True,user_id='0c9f6d6595244aa4a89ec232cb81e13a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Creating volume 2885f493-6774-4c8a-b3d2-05aacd519e40 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:05:18 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2885f493-6774-4c8a-b3d2-05aacd519e40 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7e1219-85b5-49c8-988b-965fbcc2be43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4606c33-f9a3-4807-a453-d3dc0bab9ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:18 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2885f493-6774-4c8a-b3d2-05aacd519e40 1073741824 Jul 01 04:05:18 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:18 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Volume volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c (db0ec8a1-6062-4bfe-82db-c40e6f16e18c): created successfully Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4606c33-f9a3-4807-a453-d3dc0bab9ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Flow 'volume_create_manager' (827d7514-1932-4a0a-8256-04eb18b35f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:05:18 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-bf5a1abe-341d-4bce-9c3a-0dd0d2a3bcea tempest-VolumesGetTest-541378110 None] Created volume successfully. Jul 01 04:05:19 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2885f493-6774-4c8a-b3d2-05aacd519e40 1073741824" returned: 0 in 0.924s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2885f493-6774-4c8a-b3d2-05aacd519e40 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:19 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2885f493-6774-4c8a-b3d2-05aacd519e40 Jul 01 04:05:19 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-db0ec8a1-6062-4bfe-82db-c40e6f16e18c-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Lock "cinder-db0ec8a1-6062-4bfe-82db-c40e6f16e18c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-quobyte-db0ec8a1-6062-4bfe-82db-c40e6f16e18c" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-db0ec8a1-6062-4bfe-82db-c40e6f16e18c" acquired by "delete_volume" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:19 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[42501f43-7d29-4e58-b66a-4a1b363ecc23]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:19 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c Jul 01 04:05:19 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:20 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2885f493-6774-4c8a-b3d2-05aacd519e40" returned: 0 in 0.887s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.358s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b8d9d12-ea64-4590-aa5b-3ead94f891bf,created_at=2026-07-01T02:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-435178845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b8d9d12-ea64-4590-aa5b-3ead94f891bf,host='devstack@QuobyteHD#QuobyteHD',id=c5284b23-089e-4e4b-91dc-fbbdd9351bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b52083cce14b15924c6b9689c0e2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:05:18Z,use_quota=True,user_id='bbc93f964c82418cb0b09de5583e4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27394b81-a351-4fe6-b932-1e9d61408153),volume_type_id=27394b81-a351-4fe6-b932-1e9d61408153)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Creating volume c5284b23-089e-4e4b-91dc-fbbdd9351bf2 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:05:20 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:20 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 1073741824 Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52a0c59-bcb6-4e05-9147-9154763e8d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2885f493-6774-4c8a-b3d2-05aacd519e40', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:20 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a42d56c-7bf8-4054-b23b-43d4468f6efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:20 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Volume volume-2885f493-6774-4c8a-b3d2-05aacd519e40 (2885f493-6774-4c8a-b3d2-05aacd519e40): created successfully Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a42d56c-7bf8-4054-b23b-43d4468f6efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Flow 'volume_create_manager' (ee2aab84-1c0f-4da0-9251-307dee38e23d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:05:20 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c11b6e91-bba5-4094-8297-dd18999aea95 tempest-VolumeQuotasNegativeTestJSON-244447742 None] Created volume successfully. Jul 01 04:05:20 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c" returned: 0 in 1.018s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:20 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c Jul 01 04:05:20 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:21 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 1073741824" returned: 0 in 1.375s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:21 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 Jul 01 04:05:21 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:21 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-db0ec8a1-6062-4bfe-82db-c40e6f16e18c" returned: 0 in 0.970s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-db0ec8a1-6062-4bfe-82db-c40e6f16e18c" released by "delete_volume" :: held 2.078s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:21 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Created reservations ['41c1bec5-ed0b-467e-a645-736fb41952e9', '49a1bff9-e083-4a45-b447-5b82488032f4', '67b477bc-b530-4e58-bc00-89d981422aee', '5acc413c-b724-4e95-bf10-b29d7a7296e2'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:22 devstack sudo[94803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:05:22 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Acquiring lock "cinder-2885f493-6774-4c8a-b3d2-05aacd519e40-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Lock "cinder-2885f493-6774-4c8a-b3d2-05aacd519e40-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Acquiring lock "cinder-quobyte-2885f493-6774-4c8a-b3d2-05aacd519e40" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Lock "cinder-quobyte-2885f493-6774-4c8a-b3d2-05aacd519e40" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3517e639-bd24-4c14-a467-dded8197e871]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2885f493-6774-4c8a-b3d2-05aacd519e40 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:22 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2885f493-6774-4c8a-b3d2-05aacd519e40 Jul 01 04:05:22 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:22 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2" returned: 0 in 0.786s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] <== create_volume: return (2212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8922276a-4b88-4578-afdf-325e19d441a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36868d79-3de6-4668-8be2-fc5ed0f0960f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:22 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Volume volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 (c5284b23-089e-4e4b-91dc-fbbdd9351bf2): created successfully Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36868d79-3de6-4668-8be2-fc5ed0f0960f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Flow 'volume_create_manager' (57af3713-08bb-4fc1-aaea-98b4176d826c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:05:22 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-b1ed1add-1623-4b35-9cac-bdc01fe47e0f tempest-GroupSnapshotsTest-1531675490 None] Created volume successfully. Jul 01 04:05:22 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.708s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:05:22 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Deleted volume successfully. Jul 01 04:05:22 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8bced826-dc77-485b-bc52-71724bac8b55 tempest-VolumesGetTest-541378110 None] Lock "cinder-db0ec8a1-6062-4bfe-82db-c40e6f16e18c-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:23 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2885f493-6774-4c8a-b3d2-05aacd519e40" returned: 0 in 0.826s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2885f493-6774-4c8a-b3d2-05aacd519e40 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-194076a9-eda8-4530-86a3-d82dd45fab47-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:23 devstack sudo[94812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2885f493-6774-4c8a-b3d2-05aacd519e40 Jul 01 04:05:23 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Lock "cinder-194076a9-eda8-4530-86a3-d82dd45fab47-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Acquiring lock "cinder-quobyte-194076a9-eda8-4530-86a3-d82dd45fab47" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-194076a9-eda8-4530-86a3-d82dd45fab47" acquired by "delete_volume" :: waited 0.015s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[034fca91-b14e-4e95-987c-7d66e75702cb]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:23 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 Jul 01 04:05:23 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:23 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2885f493-6774-4c8a-b3d2-05aacd519e40" returned: 0 in 0.702s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Lock "cinder-quobyte-2885f493-6774-4c8a-b3d2-05aacd519e40" released by "delete_volume" :: held 1.578s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Created reservations ['d4aad6d8-b17a-4482-8d25-7f73d08be68e', 'a017b53c-1624-485e-a1de-a390db97f431', '22805be1-9611-45ca-a776-ab10076f9a4f', 'a5eb847e-fe17-428b-8483-2e25dbd49421'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:23 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:05:23 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:23 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-32e36b49-61ec-4aa7-a28d-7d312d81022f tempest-GroupSnapshotsTest-1531675490 None] Update group completed successfully. Jul 01 04:05:24 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47" returned: 0 in 0.850s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:24 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 Jul 01 04:05:24 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:05:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:24 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:05:24 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:24 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.747s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:24 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:05:24 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Deleted volume successfully. Jul 01 04:05:24 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-92b89087-326f-4ecc-ae7e-a5389d67e77c tempest-VolumeQuotasNegativeTestJSON-244447742 None] Lock "cinder-2885f493-6774-4c8a-b3d2-05aacd519e40-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:24 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47" returned: 1 in 0.865s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:05:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:24 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47 Jul 01 04:05:24 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:25 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d49bc896-b325-4ca9-a5d8-2453f964b90a tempest-GroupSnapshotsTest-1531675490 None] Update group completed successfully. Jul 01 04:05:25 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.825s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:05:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:05:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 28 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:05:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:05:25 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-194076a9-eda8-4530-86a3-d82dd45fab47" returned: 0 in 0.842s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Lock "cinder-quobyte-194076a9-eda8-4530-86a3-d82dd45fab47" released by "delete_volume" :: held 2.627s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:25 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Created reservations ['4b50b5be-dac6-4f0b-b147-834bca67ae19', 'aa49061b-ff44-4f0d-a8ec-363c97f7da69', '57d19a6b-c57b-4e3f-bbdd-d02723235e3f', '1e5f3db7-2def-45fb-b162-a086fdff2d2f'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:25 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:05:25 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:26 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-ce9374a9-3c98-4d7b-8368-afe8cbec671b tempest-GroupSnapshotsTest-1531675490 None] Update group completed successfully. Jul 01 04:05:27 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.201s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:27 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:05:27 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Deleted volume successfully. Jul 01 04:05:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5db79b9e-5894-45fc-9db7-3df0b1c5b3bb tempest-VolumesGetTest-541378110 None] Lock "cinder-194076a9-eda8-4530-86a3-d82dd45fab47-delete_volume" released by "delete_volume" :: held 4.046s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:27 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-cf1768ac-4ce2-4673-9530-df1686c3a615 tempest-GroupSnapshotsTest-1531675490 None] Update group completed successfully. Jul 01 04:05:29 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] GroupSnapshot d3afe668-66fe-4a2b-a874-e195b7d54b70: creating. Jul 01 04:05:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Group snapshot d3afe668-66fe-4a2b-a874-e195b7d54b70: creating. {{(pid=86177) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 01 04:05:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Creating offline snapshot 3790d6bc-9a79-4aa1-b5a6-615be4973fb1 of volume c5284b23-089e-4e4b-91dc-fbbdd9351bf2 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:05:29 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eef8be-bff6-459e-a687-7c496de4ba13]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:29 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 Jul 01 04:05:29 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2" returned: 0 in 1.375s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:31 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:31 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1 1G Jul 01 04:05:31 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:31 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:05:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Flow 'volume_create_manager' (92651c2b-d2ca-460b-a1fb-d46e33c40311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:05:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ca81cc-eff5-4219-9b86-e7e00cdea90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ca81cc-eff5-4219-9b86-e7e00cdea90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1913669224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410ac0c2-2b26-4d04-b995-48af55aa27e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95734c5ad1649e3aa62a9728f277c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:05:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:05:32Z,use_quota=True,user_id='abd06a8457154a528f1aded93f39e2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bd8673-3e02-40c1-98d7-0230fb5332f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bd8673-3e02-40c1-98d7-0230fb5332f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa419ee2-6d10-46b5-9475-66327703261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa419ee2-6d10-46b5-9475-66327703261d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '410ac0c2-2b26-4d04-b995-48af55aa27e3', 'volume_name': 'volume-410ac0c2-2b26-4d04-b995-48af55aa27e3', 'volume_size': 2}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cd0d70-20d3-4605-9c72-36d846130245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cd0d70-20d3-4605-9c72-36d846130245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef0c772-67e1-4984-a568-0483e5c42ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:32 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Volume 410ac0c2-2b26-4d04-b995-48af55aa27e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-410ac0c2-2b26-4d04-b995-48af55aa27e3', 'volume_size': 2} Jul 01 04:05:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:32 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1 1G" returned: 0 in 1.397s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:32 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1 Jul 01 04:05:32 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:33 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1" returned: 0 in 0.803s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:33 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1 is being set with open permissions: ugo+rw: NotImplementedError Jul 01 04:05:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:33 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1 Jul 01 04:05:33 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:34 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1" returned: 0 in 0.798s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:34 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=129,cinder:SELECT=130,cinder:INSERT=41,cinder:DELETE=10 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:05:34 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=145,cinder:SELECT=112,cinder:DELETE=9,cinder:INSERT=30 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:05:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:34 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.info Jul 01 04:05:34 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:34 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.info" returned: 0 in 0.692s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:34 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 01 04:05:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:34 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.info Jul 01 04:05:34 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:35 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.info" returned: 0 in 0.775s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.974s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:35 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Creating offline snapshot 563a4e05-f54c-4b0b-a802-ede9913ffe3b of volume 9f545123-170c-4ed3-af70-3ebe124de5d2 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:05:35 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2120ac82-56c0-4d9e-bde3-74d825ed9247]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:35 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2 Jul 01 04:05:35 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:36 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2" returned: 0 in 1.042s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:36 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b 1G Jul 01 04:05:36 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:37 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b 1G" returned: 0 in 1.061s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f545123-170c-4ed3-af70-3ebe124de5d2 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:37 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f545123-170c-4ed3-af70-3ebe124de5d2 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b Jul 01 04:05:37 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:38 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f545123-170c-4ed3-af70-3ebe124de5d2 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b" returned: 0 in 1.030s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:38 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b is being set with open permissions: ugo+rw: NotImplementedError Jul 01 04:05:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:38 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b Jul 01 04:05:38 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:39 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b" returned: 0 in 0.916s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:39 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.info Jul 01 04:05:39 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:40 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.info" returned: 0 in 0.910s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:40 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 01 04:05:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:40 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.info Jul 01 04:05:40 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:41 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.info" returned: 0 in 0.772s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.851s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.495s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1913669224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410ac0c2-2b26-4d04-b995-48af55aa27e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95734c5ad1649e3aa62a9728f277c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:05:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:05:32Z,use_quota=True,user_id='abd06a8457154a528f1aded93f39e2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:05:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Creating volume 410ac0c2-2b26-4d04-b995-48af55aa27e3 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:05:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:05:41 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:05:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 2147483648 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:41 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 2147483648 Jul 01 04:05:41 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:41 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0bdc0413-b594-40e8-a086-79611e5f2f77 tempest-GroupSnapshotsTest-1531675490 None] group_snapshot d3afe668-66fe-4a2b-a874-e195b7d54b70: created successfully Jul 01 04:05:42 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 2147483648" returned: 0 in 1.003s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:42 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 Jul 01 04:05:42 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:42 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] group_snapshot d3afe668-66fe-4a2b-a874-e195b7d54b70: deleting Jul 01 04:05:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] group_snapshot d3afe668-66fe-4a2b-a874-e195b7d54b70: deleting {{(pid=86177) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 01 04:05:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "cinder-quobyte-c5284b23-089e-4e4b-91dc-fbbdd9351bf2" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-c5284b23-089e-4e4b-91dc-fbbdd9351bf2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "cinder-quobyte-3790d6bc-9a79-4aa1-b5a6-615be4973fb1" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-3790d6bc-9a79-4aa1-b5a6-615be4973fb1" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Deleting offline snapshot 3790d6bc-9a79-4aa1-b5a6-615be4973fb1 of volume c5284b23-089e-4e4b-91dc-fbbdd9351bf2 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:05:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] snapshot_file for this snap is: volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:05:42 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14d785d-1ec3-4970-8393-f3ecdd9ec6f3]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:43 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1 Jul 01 04:05:43 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:43 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3" returned: 0 in 0.803s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:05:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef0c772-67e1-4984-a568-0483e5c42ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-410ac0c2-2b26-4d04-b995-48af55aa27e3', 'volume_size': 2}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d3fc5b-6c9e-4d6b-bf1f-8ae37294d5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:43 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Volume volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 (410ac0c2-2b26-4d04-b995-48af55aa27e3): created successfully Jul 01 04:05:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d3fc5b-6c9e-4d6b-bf1f-8ae37294d5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Flow 'volume_create_manager' (92651c2b-d2ca-460b-a1fb-d46e33c40311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:05:43 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8c30658e-108d-480e-9f9c-255de724952f tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Created volume successfully. Jul 01 04:05:43 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1" returned: 0 in 0.860s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:05:43 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[bceaf625-0c99-4ce6-b666-1ac70df5fd2e]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:43 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 Jul 01 04:05:43 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Creating offline snapshot 9c741f5a-4279-45d2-996e-8bcf6c246f21 of volume 410ac0c2-2b26-4d04-b995-48af55aa27e3 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:05:44 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f2bf80-37df-4bbf-89c1-22fd2414c798]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:44 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 Jul 01 04:05:44 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:44 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2" returned: 0 in 0.894s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:44 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1 Jul 01 04:05:44 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:45 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3" returned: 0 in 0.926s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21 2G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:45 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21 2G Jul 01 04:05:45 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:45 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1" returned: 0 in 0.881s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:45 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1 Jul 01 04:05:45 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:46 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21 2G" returned: 0 in 0.915s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:46 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21 Jul 01 04:05:46 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:46 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2.3790d6bc-9a79-4aa1-b5a6-615be4973fb1" returned: 0 in 0.791s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-3790d6bc-9a79-4aa1-b5a6-615be4973fb1" released by "_delete_snapshot" :: held 3.597s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-c5284b23-089e-4e4b-91dc-fbbdd9351bf2" released by "delete_snapshot" :: held 3.636s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "cinder-quobyte-9f545123-170c-4ed3-af70-3ebe124de5d2" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-9f545123-170c-4ed3-af70-3ebe124de5d2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "cinder-quobyte-563a4e05-f54c-4b0b-a802-ede9913ffe3b" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-563a4e05-f54c-4b0b-a802-ede9913ffe3b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Deleting offline snapshot 563a4e05-f54c-4b0b-a802-ede9913ffe3b of volume 9f545123-170c-4ed3-af70-3ebe124de5d2 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:05:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] snapshot_file for this snap is: volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:05:46 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[672b3143-b488-4259-99ea-7bff3569d27d]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:46 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b Jul 01 04:05:46 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:47 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21" returned: 0 in 0.943s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:47 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21 is being set with open permissions: ugo+rw Jul 01 04:05:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:47 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21 Jul 01 04:05:47 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:47 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b" returned: 0 in 0.993s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f545123-170c-4ed3-af70-3ebe124de5d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:05:47 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[39af9e9f-b457-4131-acc2-6f582413d3e1]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:47 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2 Jul 01 04:05:47 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:47 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21" returned: 0 in 0.739s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:47 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.info Jul 01 04:05:47 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:48 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2" returned: 0 in 0.927s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:48 devstack sudo[95043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b Jul 01 04:05:48 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:48 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.info" returned: 0 in 0.843s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:48 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.info is being set with open permissions: ugo+rw Jul 01 04:05:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:48 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.info Jul 01 04:05:48 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:49 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b" returned: 0 in 0.857s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:49 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b Jul 01 04:05:49 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:49 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.info" returned: 0 in 0.851s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.323s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:49 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f7400c4a-9863-455b-b161-d0ba9c512607 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Create snapshot completed successfully Jul 01 04:05:50 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2.563a4e05-f54c-4b0b-a802-ede9913ffe3b" returned: 0 in 0.888s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-563a4e05-f54c-4b0b-a802-ede9913ffe3b" released by "_delete_snapshot" :: held 3.827s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-9f545123-170c-4ed3-af70-3ebe124de5d2" released by "delete_snapshot" :: held 3.857s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:50 devstack cinder-volume[86177]: WARNING cinder.quota [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1756600033 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1756600033, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:05:50 devstack cinder-volume[86177]: WARNING cinder.quota [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1756600033 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1756600033, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:05:50 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Created reservations ['88e71fe8-b164-449c-aebe-2b18fdb5a312', 'df6e5143-4676-44dc-83ec-c67a411b8b03', '4c98a81e-1c4d-4e7a-bf7a-497782802206', '05e69982-4c06-41d0-a659-5d5c5724f78d'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:50 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] Created reservations ['47680fd4-c987-4b91-b6aa-f5056b5c3e55', 'b4708eee-2e6e-41c0-91f1-03624f06ced6', 'f891403c-6d16-4a03-9122-d4b31a186c91', '134286c6-797e-40ab-a696-5ae1fec2ec27'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:50 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8b41a068-d62b-453a-bed2-ef9bdd9788c4 tempest-GroupSnapshotsTest-1531675490 None] group_snapshot d3afe668-66fe-4a2b-a874-e195b7d54b70: deleted successfully Jul 01 04:05:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Acquiring lock "cinder-9c741f5a-4279-45d2-996e-8bcf6c246f21-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "cinder-9c741f5a-4279-45d2-996e-8bcf6c246f21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Acquiring lock "cinder-quobyte-410ac0c2-2b26-4d04-b995-48af55aa27e3" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "cinder-quobyte-410ac0c2-2b26-4d04-b995-48af55aa27e3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Acquiring lock "cinder-quobyte-9c741f5a-4279-45d2-996e-8bcf6c246f21" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "cinder-quobyte-9c741f5a-4279-45d2-996e-8bcf6c246f21" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Deleting offline snapshot 9c741f5a-4279-45d2-996e-8bcf6c246f21 of volume 410ac0c2-2b26-4d04-b995-48af55aa27e3 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:05:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] snapshot_file for this snap is: volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:05:50 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d1a78b-51b3-4c66-aa0f-b19bf86a7da6]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:51 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21 Jul 01 04:05:51 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:51 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21" returned: 0 in 0.859s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-410ac0c2-2b26-4d04-b995-48af55aa27e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:05:51 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77b459b-700e-4e59-9f1c-c50f58064ade]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:51 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 Jul 01 04:05:51 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "cinder-quobyte-9f545123-170c-4ed3-af70-3ebe124de5d2" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-9f545123-170c-4ed3-af70-3ebe124de5d2" acquired by "delete_volume" :: waited 0.048s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:52 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2563378d-235c-48e1-a4de-b155b71d0990]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:52 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2 Jul 01 04:05:52 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:52 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3" returned: 0 in 1.037s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:52 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21 Jul 01 04:05:52 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:53 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2" returned: 0 in 0.922s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:53 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2 Jul 01 04:05:53 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:53 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21" returned: 0 in 1.080s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:54 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21 Jul 01 04:05:54 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:54 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f545123-170c-4ed3-af70-3ebe124de5d2" returned: 0 in 1.031s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-9f545123-170c-4ed3-af70-3ebe124de5d2" released by "delete_volume" :: held 2.115s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "cinder-quobyte-c5284b23-089e-4e4b-91dc-fbbdd9351bf2" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-c5284b23-089e-4e4b-91dc-fbbdd9351bf2" acquired by "delete_volume" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:54 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[25753e45-e52f-4d92-b6a5-b5da73eb1230]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:54 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 Jul 01 04:05:54 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:55 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3.9c741f5a-4279-45d2-996e-8bcf6c246f21" returned: 0 in 1.111s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "cinder-quobyte-9c741f5a-4279-45d2-996e-8bcf6c246f21" released by "_delete_snapshot" :: held 4.248s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "cinder-quobyte-410ac0c2-2b26-4d04-b995-48af55aa27e3" released by "delete_snapshot" :: held 4.277s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:55 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Created reservations ['5b2f850e-9784-4318-aa74-b7326ae1abb5', 'c9dd51bd-ef68-4f4c-98d3-d9ad088a5bf6', '97ad1b9a-9b26-4b2f-9cf9-a3dca6eebb97', '2eb9cbc1-7113-471a-b6d2-534f72a3f8be'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:55 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Delete snapshot completed successfully. Jul 01 04:05:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d91ce8ec-b2c6-42f9-8c6a-f7dbf42c61bb tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "cinder-9c741f5a-4279-45d2-996e-8bcf6c246f21-delete_snapshot" released by "delete_snapshot" :: held 4.484s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:55 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2" returned: 0 in 0.984s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:55 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2 Jul 01 04:05:55 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Acquiring lock "cinder-410ac0c2-2b26-4d04-b995-48af55aa27e3-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:56 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "cinder-410ac0c2-2b26-4d04-b995-48af55aa27e3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5284b23-089e-4e4b-91dc-fbbdd9351bf2" returned: 0 in 0.906s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-c5284b23-089e-4e4b-91dc-fbbdd9351bf2" released by "delete_volume" :: held 2.009s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Acquiring lock "cinder-quobyte-410ac0c2-2b26-4d04-b995-48af55aa27e3" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "cinder-quobyte-410ac0c2-2b26-4d04-b995-48af55aa27e3" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ab204f-1f16-4e9d-8ca9-082ed89eb06c]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Created reservations ['d16b2144-63d1-4657-b863-bb9f9ebd46b8'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:56 devstack cinder-volume[86177]: WARNING cinder.quota [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1756600033 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1756600033, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Created reservations ['d8df082d-aae0-42f1-9a0f-5e93651d402d', 'a2c0adb0-2ad5-46a1-8055-93eff3508397', '4fbb0c05-f9e9-4ec0-b6b1-938990281234', 'a01f88af-a53f-4e4f-bfe6-9030982c5927'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:56 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 Jul 01 04:05:56 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Created reservations ['8fc2c479-a091-4351-a976-5ae6d305f198', 'bff74e03-a898-4ff5-83fa-3cbafac9fbbc', '904a4219-2628-4ab6-bf3b-72cdee7f1489', '4f6d683a-5c8b-47be-b8fd-a32af904e468'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:56 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:05:56 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:57 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3" returned: 0 in 1.003s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:57 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3 Jul 01 04:05:57 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:57 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.851s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:57 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:05:57 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-46e86d80-2f50-4909-bc71-e017841f5cd4 tempest-GroupSnapshotsTest-1531675490 None] Delete group completed successfully. Jul 01 04:05:58 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-45052fce-446e-412c-ac34-bfc9873ae7dd tempest-GroupSnapshotsTest-1531675490 None] Group tempest-GroupSnapshotsTest-Group-1668870632: creating Jul 01 04:05:58 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-45052fce-446e-412c-ac34-bfc9873ae7dd tempest-GroupSnapshotsTest-1531675490 None] Group tempest-GroupSnapshotsTest-Group-1668870632: created successfully Jul 01 04:05:58 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-45052fce-446e-412c-ac34-bfc9873ae7dd tempest-GroupSnapshotsTest-1531675490 None] Create group completed successfully. Jul 01 04:05:58 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-410ac0c2-2b26-4d04-b995-48af55aa27e3" returned: 0 in 0.803s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:58 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "cinder-quobyte-410ac0c2-2b26-4d04-b995-48af55aa27e3" released by "delete_volume" :: held 1.883s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:58 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Created reservations ['7515b975-3dde-4e03-98a1-6a72b9e5f39d', '7bdb5d91-2cd4-4911-a75e-b96a407e9a16', '47e27f14-72a9-46be-8404-61086e6d55ee', '909bc318-b0ac-45b4-801f-8ac5a82a7d62'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:05:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:05:58 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:05:58 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:05:59 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.703s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:05:59 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Deleted volume successfully. Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-de3ed7e4-4f6b-44ba-93d7-8e9ac9e14e17 tempest-VolumesSnapshotNegativeTestJSON-1374746109 None] Lock "cinder-410ac0c2-2b26-4d04-b995-48af55aa27e3-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Flow 'volume_create_manager' (79df8a27-ceef-4b5b-b93f-0e7af06fb503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4fdd59-3113-4f01-99aa-b0358d3d2a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4fdd59-3113-4f01-99aa-b0358d3d2a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2142884957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d491c9fa-3184-4a2e-9118-71bfd379c9de,host='devstack@QuobyteHD#QuobyteHD',id=8b4f2048-f89f-43c2-b359-36f2fb6d0fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b52083cce14b15924c6b9689c0e2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:06:00Z,use_quota=True,user_id='bbc93f964c82418cb0b09de5583e4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82275a98-2b98-4856-a059-0f7b12144e11),volume_type_id=82275a98-2b98-4856-a059-0f7b12144e11)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406184ac-3a51-4cab-beca-ac914625bed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406184ac-3a51-4cab-beca-ac914625bed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ec9afb-0c20-4478-a9d8-6a55ba07ab92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ec9afb-0c20-4478-a9d8-6a55ba07ab92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b4f2048-f89f-43c2-b359-36f2fb6d0fc4', 'volume_name': 'volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40d7e39-f4dc-425b-bc28-c200710d9f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40d7e39-f4dc-425b-bc28-c200710d9f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51970d23-e335-4ae5-a8ac-2a1258b8198e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:05:59 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Volume 8b4f2048-f89f-43c2-b359-36f2fb6d0fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4', 'volume_size': 1} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d491c9fa-3184-4a2e-9118-71bfd379c9de,created_at=2026-07-01T02:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2142884957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d491c9fa-3184-4a2e-9118-71bfd379c9de,host='devstack@QuobyteHD#QuobyteHD',id=8b4f2048-f89f-43c2-b359-36f2fb6d0fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b52083cce14b15924c6b9689c0e2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:06:00Z,use_quota=True,user_id='bbc93f964c82418cb0b09de5583e4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82275a98-2b98-4856-a059-0f7b12144e11),volume_type_id=82275a98-2b98-4856-a059-0f7b12144e11)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Creating volume 8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:05:59 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:05:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:00 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 1073741824 Jul 01 04:06:00 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:01 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 1073741824" returned: 0 in 1.110s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:01 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 Jul 01 04:06:01 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:01 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4" returned: 0 in 0.848s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:01 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:06:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51970d23-e335-4ae5-a8ac-2a1258b8198e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7353e9-aad1-460f-84da-c11e93fd0d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:02 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Volume volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 (8b4f2048-f89f-43c2-b359-36f2fb6d0fc4): created successfully Jul 01 04:06:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7353e9-aad1-460f-84da-c11e93fd0d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Flow 'volume_create_manager' (79df8a27-ceef-4b5b-b93f-0e7af06fb503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:06:02 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8a07449f-c99c-4ff4-b160-c8e5b6ee7300 tempest-GroupSnapshotsTest-1531675490 None] Created volume successfully. Jul 01 04:06:02 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] GroupSnapshot f84d292e-74b9-4ede-abe1-43770d106266: creating. Jul 01 04:06:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] Group snapshot f84d292e-74b9-4ede-abe1-43770d106266: creating. {{(pid=86177) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 01 04:06:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] Creating offline snapshot 5f8454e5-313f-494a-a526-82203b083c66 of volume 8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:06:02 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1112777b-b837-441b-8281-a91d99051027]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:06:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:02 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 Jul 01 04:06:02 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:03 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-74fc1804-13f6-4547-84a1-3fc51f2df418 req-1b70b268-3e25-400d-aba1-7854b9e6a9c7 tempest-AttachVolumeNegativeTest-962019476 None] Terminate volume connection completed successfully. Jul 01 04:06:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-74fc1804-13f6-4547-84a1-3fc51f2df418 req-1b70b268-3e25-400d-aba1-7854b9e6a9c7 tempest-AttachVolumeNegativeTest-962019476 None] Deleting attachment 9b4bd336-89c1-4550-ac63-1aedbd5ecdd8. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:06:04 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4" returned: 0 in 1.378s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:04 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66 1G Jul 01 04:06:04 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:05 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66 1G" returned: 0 in 1.143s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:05 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66 Jul 01 04:06:05 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:06 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66" returned: 0 in 0.890s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:06 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66 is being set with open permissions: ugo+rw: NotImplementedError Jul 01 04:06:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:06 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66 Jul 01 04:06:06 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:06 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66" returned: 0 in 0.884s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:07 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.info Jul 01 04:06:07 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:08 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.info" returned: 0 in 1.009s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:08 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 01 04:06:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:08 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.info Jul 01 04:06:08 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:08 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.info" returned: 0 in 0.712s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.177s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:08 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-e7e8d1ec-4d42-450e-8412-3c11af34494b tempest-GroupSnapshotsTest-1531675490 None] group_snapshot f84d292e-74b9-4ede-abe1-43770d106266: created successfully Jul 01 04:06:09 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] group_snapshot f84d292e-74b9-4ede-abe1-43770d106266: deleting Jul 01 04:06:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] group_snapshot f84d292e-74b9-4ede-abe1-43770d106266: deleting {{(pid=86177) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 01 04:06:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "cinder-quobyte-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "cinder-quobyte-5f8454e5-313f-494a-a526-82203b083c66" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-5f8454e5-313f-494a-a526-82203b083c66" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] Deleting offline snapshot 5f8454e5-313f-494a-a526-82203b083c66 of volume 8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:06:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] snapshot_file for this snap is: volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:06:09 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[07117a6b-8146-4644-9cea-8c8ea9e95f3e]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:06:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:09 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66 Jul 01 04:06:09 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:11 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66" returned: 0 in 1.578s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:06:11 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdef1ccd-8194-403b-a8ed-4b626747621f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:06:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:11 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 Jul 01 04:06:11 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:12 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4" returned: 0 in 1.345s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:12 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66 Jul 01 04:06:12 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:14 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66" returned: 0 in 1.596s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:14 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66 Jul 01 04:06:14 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:15 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4.5f8454e5-313f-494a-a526-82203b083c66" returned: 0 in 0.972s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:15 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-5f8454e5-313f-494a-a526-82203b083c66" released by "_delete_snapshot" :: held 5.673s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:06:15 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4" released by "delete_snapshot" :: held 5.707s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:06:15 devstack cinder-volume[86177]: WARNING cinder.quota [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-963074199 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-963074199, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:06:15 devstack cinder-volume[86177]: WARNING cinder.quota [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-963074199 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-963074199, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:06:15 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] Created reservations ['ecad8ddf-7c2b-4fc3-8706-c6e0b1422e5a', '9ae49a17-7e6d-4e76-a115-c418fcd21841', '4fd65bed-1248-454f-8c16-3582453c755c', '18cb8b8d-be2b-4971-aaa4-0b0610be2b70'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:06:15 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-555f2b7a-782a-4dd6-9d99-0d99e4dc0753 tempest-GroupSnapshotsTest-1531675490 None] group_snapshot f84d292e-74b9-4ede-abe1-43770d106266: deleted successfully Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Flow 'volume_create_manager' (b327f525-18b2-419d-9433-604934820d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2eef03-64ee-4365-bf0a-638beca4e64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2eef03-64ee-4365-bf0a-638beca4e64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1928180598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7aff4b-0c5b-4d13-8253-8d177fc24fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d93025f46c645438c8ea92725b7c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:06:16Z,use_quota=True,user_id='455a8506e47d440ebb1a95775621b084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d32294-6dca-469b-956d-e4ad5de59ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d32294-6dca-469b-956d-e4ad5de59ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c51544-2a43-4c3d-a87e-dcf29a75a634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c51544-2a43-4c3d-a87e-dcf29a75a634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7aff4b-0c5b-4d13-8253-8d177fc24fe4', 'volume_name': 'volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c5bd61-3147-425b-9021-c8b8ba56b639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c5bd61-3147-425b-9021-c8b8ba56b639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7193ec3c-907e-47c7-8bd8-4c0b309f6d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:16 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Volume 4d7aff4b-0c5b-4d13-8253-8d177fc24fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4', 'volume_size': 1} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1928180598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7aff4b-0c5b-4d13-8253-8d177fc24fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d93025f46c645438c8ea92725b7c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:06:16Z,use_quota=True,user_id='455a8506e47d440ebb1a95775621b084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Creating volume 4d7aff4b-0c5b-4d13-8253-8d177fc24fe4 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:06:16 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:16 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4 1073741824 Jul 01 04:06:16 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "cinder-quobyte-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4" acquired by "delete_volume" :: waited 0.030s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0224903-2972-4bed-908f-389b84b227cc]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:06:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:16 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 Jul 01 04:06:16 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:18 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4" returned: 0 in 1.472s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:18 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4 1073741824" returned: 0 in 1.934s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:18 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4 Jul 01 04:06:18 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:18 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4 Jul 01 04:06:18 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:19 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4" returned: 0 in 1.225s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Lock "cinder-quobyte-8b4f2048-f89f-43c2-b359-36f2fb6d0fc4" released by "delete_volume" :: held 2.811s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:06:19 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4" returned: 0 in 1.160s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] <== create_volume: return (3189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.192s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7193ec3c-907e-47c7-8bd8-4c0b309f6d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba255a2-d39c-4d0d-9a1d-a14dd8611b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:19 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Volume volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4 (4d7aff4b-0c5b-4d13-8253-8d177fc24fe4): created successfully Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba255a2-d39c-4d0d-9a1d-a14dd8611b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Flow 'volume_create_manager' (b327f525-18b2-419d-9433-604934820d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:06:19 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c6225600-03f4-4b58-857c-c417e66b46c5 tempest-VolumesActionsTest-869694445 None] Created volume successfully. Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Created reservations ['ead1c408-9872-455b-8ff9-378b20df1d65'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:06:19 devstack cinder-volume[86177]: WARNING cinder.quota [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-963074199 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-963074199, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Created reservations ['674774a5-11a8-4953-abbd-9e96d7e91f12', '35824bed-e7e9-47a5-8966-901560312a0a', '978f2ddd-7334-4397-84c5-117eaf830619', 'e4ce6e62-7d95-4b2c-9490-5e3e5ba685e8'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:20 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:06:20 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d905dbba-2a56-44b6-a86b-6e464a07ee61 tempest-VolumesActionsTest-869694445 None] Acquiring lock "cinder-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4" by "attach_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d905dbba-2a56-44b6-a86b-6e464a07ee61 tempest-VolumesActionsTest-869694445 None] Lock "cinder-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4" acquired by "attach_volume" :: waited 0.038s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:20 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d905dbba-2a56-44b6-a86b-6e464a07ee61 tempest-VolumesActionsTest-869694445 None] Attaching volume 4d7aff4b-0c5b-4d13-8253-8d177fc24fe4 to instance bf0bbc89-b9ca-4be0-9399-e893937a10cf at mountpoint /dev/vdb on host None. Jul 01 04:06:20 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d905dbba-2a56-44b6-a86b-6e464a07ee61 tempest-VolumesActionsTest-869694445 None] Attach volume completed successfully. Jul 01 04:06:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d905dbba-2a56-44b6-a86b-6e464a07ee61 tempest-VolumesActionsTest-869694445 None] Lock "cinder-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4" released by "attach_volume" :: held 0.268s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:06:21 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.286s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:21 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:06:21 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-7d751d69-e622-468f-b8ab-bbd0298c7001 tempest-GroupSnapshotsTest-1531675490 None] Delete group completed successfully. Jul 01 04:06:22 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-77d4a52c-75ae-4f04-9af4-4852f812c528 tempest-VolumesActionsTest-1725792442 None] Terminate volume connection completed successfully. Jul 01 04:06:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-77d4a52c-75ae-4f04-9af4-4852f812c528 tempest-VolumesActionsTest-1725792442 None] Acquiring lock "cinder-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4-detach_volume" by "detach_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-77d4a52c-75ae-4f04-9af4-4852f812c528 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:23 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-77d4a52c-75ae-4f04-9af4-4852f812c528 tempest-VolumesActionsTest-1725792442 None] Detaching volume 4d7aff4b-0c5b-4d13-8253-8d177fc24fe4 from instance bf0bbc89-b9ca-4be0-9399-e893937a10cf. Jul 01 04:06:23 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-77d4a52c-75ae-4f04-9af4-4852f812c528 tempest-VolumesActionsTest-1725792442 None] Detach volume completed successfully. Jul 01 04:06:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-77d4a52c-75ae-4f04-9af4-4852f812c528 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4-detach_volume" released by "detach_volume" :: held 0.134s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:06:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-65bdecd4-c0af-4fbf-832f-71a1dd077b91 tempest-VolumesActionsTest-869694445 None] Acquiring lock "cinder-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4-detach_volume" by "detach_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-65bdecd4-c0af-4fbf-832f-71a1dd077b91 tempest-VolumesActionsTest-869694445 None] Lock "cinder-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:23 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-65bdecd4-c0af-4fbf-832f-71a1dd077b91 tempest-VolumesActionsTest-869694445 None] Volume detach called, but volume not attached. Jul 01 04:06:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-65bdecd4-c0af-4fbf-832f-71a1dd077b91 tempest-VolumesActionsTest-869694445 None] Lock "cinder-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:06:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:06:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:06:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:06:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:24 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:06:24 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:24 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Acquiring lock "cinder-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:24 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Lock "cinder-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:24 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Acquiring lock "cinder-quobyte-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:24 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Lock "cinder-quobyte-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4" acquired by "delete_volume" :: waited 0.041s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:24 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7541b097-61a0-4614-a212-ad0a99fe71f1]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:06:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:25 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4 Jul 01 04:06:25 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:25 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.923s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:06:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:06:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 28 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:06:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:06:25 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4" returned: 0 in 1.115s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:25 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4 Jul 01 04:06:25 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:26 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4" returned: 0 in 0.852s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Lock "cinder-quobyte-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4" released by "delete_volume" :: held 2.035s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:06:26 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Created reservations ['33eccc65-e7ca-48da-8b17-85341d61acfd', 'a84f999b-46b9-44ca-9ec8-caaa5d313ebe', 'ba316b83-0231-479a-8cfa-244958bb89a5', '582e4974-65ab-4711-82ce-f7bb3a19199d'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:06:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:06:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:06:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:27 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:06:27 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:27 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.848s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:27 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:06:27 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Deleted volume successfully. Jul 01 04:06:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d4585b72-f096-4428-a2c3-889db84c4277 tempest-VolumesActionsTest-869694445 None] Lock "cinder-4d7aff4b-0c5b-4d13-8253-8d177fc24fe4-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:06:36 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=84,cinder:INSERT=21,cinder:UPDATE=80,cinder:DELETE=4 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:06:37 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=87,cinder:UPDATE=98,cinder:INSERT=26,cinder:DELETE=2 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Flow 'volume_create_manager' (e9767651-6eed-4ab3-a437-a63ca57d36dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0b947a-28d9-4d94-b208-18339a1bb43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0b947a-28d9-4d94-b208-18339a1bb43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1210171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5679af58-a0da-48a6-9073-d4d61c2e6b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d93025f46c645438c8ea92725b7c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:06:38Z,use_quota=True,user_id='455a8506e47d440ebb1a95775621b084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f334e1-a26c-4642-a0c4-7ac2aefc009b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f334e1-a26c-4642-a0c4-7ac2aefc009b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c92e0b-f989-45a2-94ac-b0bd5381ee28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c92e0b-f989-45a2-94ac-b0bd5381ee28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5679af58-a0da-48a6-9073-d4d61c2e6b96', 'volume_name': 'volume-5679af58-a0da-48a6-9073-d4d61c2e6b96', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bde0acd-fe0a-4746-be59-dfadde154876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bde0acd-fe0a-4746-be59-dfadde154876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0f0ccf-0062-49df-bec7-c44ed8a49842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:38 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Volume 5679af58-a0da-48a6-9073-d4d61c2e6b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5679af58-a0da-48a6-9073-d4d61c2e6b96', 'volume_size': 1} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1210171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5679af58-a0da-48a6-9073-d4d61c2e6b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d93025f46c645438c8ea92725b7c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:06:38Z,use_quota=True,user_id='455a8506e47d440ebb1a95775621b084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Creating volume 5679af58-a0da-48a6-9073-d4d61c2e6b96 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:06:38 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:06:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5679af58-a0da-48a6-9073-d4d61c2e6b96 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:38 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5679af58-a0da-48a6-9073-d4d61c2e6b96 1073741824 Jul 01 04:06:38 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:40 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5679af58-a0da-48a6-9073-d4d61c2e6b96 1073741824" returned: 0 in 1.416s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5679af58-a0da-48a6-9073-d4d61c2e6b96 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:40 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5679af58-a0da-48a6-9073-d4d61c2e6b96 Jul 01 04:06:40 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:41 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5679af58-a0da-48a6-9073-d4d61c2e6b96" returned: 0 in 1.141s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] <== create_volume: return (2614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:06:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.622s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0f0ccf-0062-49df-bec7-c44ed8a49842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5679af58-a0da-48a6-9073-d4d61c2e6b96', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c62d5e-4c30-4967-8dcd-ff5df416f6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:41 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Volume volume-5679af58-a0da-48a6-9073-d4d61c2e6b96 (5679af58-a0da-48a6-9073-d4d61c2e6b96): created successfully Jul 01 04:06:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c62d5e-4c30-4967-8dcd-ff5df416f6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Flow 'volume_create_manager' (e9767651-6eed-4ab3-a437-a63ca57d36dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:06:41 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-89641066-7aa7-4471-a1ee-cdfbb9724e0e tempest-VolumesActionsTest-869694445 None] Created volume successfully. Jul 01 04:06:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Acquiring lock "cinder-5679af58-a0da-48a6-9073-d4d61c2e6b96-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-5679af58-a0da-48a6-9073-d4d61c2e6b96-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Acquiring lock "cinder-quobyte-5679af58-a0da-48a6-9073-d4d61c2e6b96" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-quobyte-5679af58-a0da-48a6-9073-d4d61c2e6b96" acquired by "delete_volume" :: waited 0.033s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:42 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabd0eac-124a-4428-9246-04c05bfb71a7]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:06:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5679af58-a0da-48a6-9073-d4d61c2e6b96 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:42 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5679af58-a0da-48a6-9073-d4d61c2e6b96 Jul 01 04:06:42 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:43 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5679af58-a0da-48a6-9073-d4d61c2e6b96" returned: 0 in 1.380s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5679af58-a0da-48a6-9073-d4d61c2e6b96 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:43 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5679af58-a0da-48a6-9073-d4d61c2e6b96 Jul 01 04:06:43 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:44 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5679af58-a0da-48a6-9073-d4d61c2e6b96" returned: 0 in 1.150s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-quobyte-5679af58-a0da-48a6-9073-d4d61c2e6b96" released by "delete_volume" :: held 2.637s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:06:45 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Created reservations ['eee48e87-a51b-42c2-a77f-cfcb95dc3340', '513409e6-65a1-44f1-87a6-990ce8616d05', '638af10e-3f03-406f-812e-62066e3375f5', 'b41a390e-5f87-47d1-96cb-6320dd497411'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:06:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:45 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:06:45 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:06:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:45 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:06:45 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:46 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.332s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:46 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:06:46 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Deleted volume successfully. Jul 01 04:06:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7b8ed098-8f13-451e-8dc1-616037b3cf02 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-5679af58-a0da-48a6-9073-d4d61c2e6b96-delete_volume" released by "delete_volume" :: held 4.527s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Flow 'volume_create_manager' (ca1f91ee-0592-4d7a-8fde-4a007e1838a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2333d06e-3a20-4327-962c-2f6754c360a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2333d06e-3a20-4327-962c-2f6754c360a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1629703380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b447c6c6-b8d3-4d99-ab93-7b4bff4e761d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d93025f46c645438c8ea92725b7c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:06:47Z,use_quota=True,user_id='455a8506e47d440ebb1a95775621b084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a205a7-0bbe-4382-b0f6-c9a8466d4147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a205a7-0bbe-4382-b0f6-c9a8466d4147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d010fd-475b-4e62-b80c-2bffe4119ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d010fd-475b-4e62-b80c-2bffe4119ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b447c6c6-b8d3-4d99-ab93-7b4bff4e761d', 'volume_name': 'volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d26dca-8a3d-4585-9c12-721474505b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d26dca-8a3d-4585-9c12-721474505b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4ec1dc-ed49-4882-a782-cd9542f33c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:47 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Volume b447c6c6-b8d3-4d99-ab93-7b4bff4e761d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d', 'volume_size': 1} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1629703380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b447c6c6-b8d3-4d99-ab93-7b4bff4e761d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d93025f46c645438c8ea92725b7c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:06:47Z,use_quota=True,user_id='455a8506e47d440ebb1a95775621b084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Creating volume b447c6c6-b8d3-4d99-ab93-7b4bff4e761d {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:06:47 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:47 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d 1073741824 Jul 01 04:06:47 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Flow 'volume_create_manager' (2cc5dae0-cc7b-483e-8a5d-29d5696cdbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4b33c1-b57f-497e-a684-bc1e7db888a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4b33c1-b57f-497e-a684-bc1e7db888a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1711314699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3581164-5550-43d2-b25d-181c82c17653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a809c8bfafe448f7ab21caf41f45f420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:06:47Z,use_quota=True,user_id='3beb90c3882a433ca0ef829b24102139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e330baf-4907-442f-90ea-2aff023462f0),volume_type_id=7e330baf-4907-442f-90ea-2aff023462f0)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf738ef-0148-4b0d-b513-318140bfac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf738ef-0148-4b0d-b513-318140bfac2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9779923c-5ab2-4b1b-bc06-45f0dd522458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9779923c-5ab2-4b1b-bc06-45f0dd522458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3581164-5550-43d2-b25d-181c82c17653', 'volume_name': 'volume-f3581164-5550-43d2-b25d-181c82c17653', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ebe69d-0185-4aa8-bbd1-404cad7cd724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ebe69d-0185-4aa8-bbd1-404cad7cd724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49fd9dd-3e55-44e8-ab6d-02a90b4b608d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:47 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Volume f3581164-5550-43d2-b25d-181c82c17653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3581164-5550-43d2-b25d-181c82c17653', 'volume_size': 1} Jul 01 04:06:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:48 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d 1073741824" returned: 0 in 0.991s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:48 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d Jul 01 04:06:48 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:48 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d" returned: 0 in 0.691s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.316s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1711314699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3581164-5550-43d2-b25d-181c82c17653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a809c8bfafe448f7ab21caf41f45f420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:06:47Z,use_quota=True,user_id='3beb90c3882a433ca0ef829b24102139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e330baf-4907-442f-90ea-2aff023462f0),volume_type_id=7e330baf-4907-442f-90ea-2aff023462f0)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Creating volume f3581164-5550-43d2-b25d-181c82c17653 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:06:48 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3581164-5550-43d2-b25d-181c82c17653 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:48 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3581164-5550-43d2-b25d-181c82c17653 1073741824 Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4ec1dc-ed49-4882-a782-cd9542f33c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:48 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9198a96-b196-4fd6-8618-1d8e58a884c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:48 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Volume volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d (b447c6c6-b8d3-4d99-ab93-7b4bff4e761d): created successfully Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9198a96-b196-4fd6-8618-1d8e58a884c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:48 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Flow 'volume_create_manager' (ca1f91ee-0592-4d7a-8fde-4a007e1838a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:06:48 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-2e983e2d-380c-4617-b6f0-695f9e2bd491 tempest-VolumesActionsTest-869694445 None] Created volume successfully. Jul 01 04:06:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3581164-5550-43d2-b25d-181c82c17653 1073741824" returned: 0 in 0.914s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:49 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3581164-5550-43d2-b25d-181c82c17653 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:49 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3581164-5550-43d2-b25d-181c82c17653 Jul 01 04:06:49 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Acquiring lock "cinder-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Acquiring lock "cinder-quobyte-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-quobyte-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d" acquired by "delete_volume" :: waited 0.033s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:50 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f34d76-ec8b-4f56-abfe-d52f977cd8e3]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:06:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:50 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d Jul 01 04:06:50 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:50 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3581164-5550-43d2-b25d-181c82c17653" returned: 0 in 0.733s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:06:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49fd9dd-3e55-44e8-ab6d-02a90b4b608d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3581164-5550-43d2-b25d-181c82c17653', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abe9965-030f-4aaf-9d56-eedc316d291e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:50 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Volume volume-f3581164-5550-43d2-b25d-181c82c17653 (f3581164-5550-43d2-b25d-181c82c17653): created successfully Jul 01 04:06:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abe9965-030f-4aaf-9d56-eedc316d291e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Flow 'volume_create_manager' (2cc5dae0-cc7b-483e-8a5d-29d5696cdbf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:06:50 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-77916d05-f9e2-4f81-a14d-081f9c78b7c6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Created volume successfully. Jul 01 04:06:51 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d" returned: 0 in 0.817s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:51 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d Jul 01 04:06:51 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:52 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d" returned: 0 in 1.085s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-quobyte-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d" released by "delete_volume" :: held 1.963s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:06:52 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Created reservations ['695a289a-24e7-4a6e-955f-be4f76e53fb7', '7efe3896-6063-4a16-9d6a-31afc8d03a2f', 'e543d97a-c7f0-4413-97e2-a180383f71d6', '89ee9a29-8938-4a13-865a-b95130ca6afe'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:06:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:06:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:06:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-095895d7-74a5-48b9-8105-1df1cb57c4f6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-095895d7-74a5-48b9-8105-1df1cb57c4f6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-095895d7-74a5-48b9-8105-1df1cb57c4f6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:06:52 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:06:52 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-095895d7-74a5-48b9-8105-1df1cb57c4f6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:06:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-095895d7-74a5-48b9-8105-1df1cb57c4f6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-095895d7-74a5-48b9-8105-1df1cb57c4f6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:52 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:06:52 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:53 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.743s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:53 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:53 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:06:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-095895d7-74a5-48b9-8105-1df1cb57c4f6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.669s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:53 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-095895d7-74a5-48b9-8105-1df1cb57c4f6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:06:53 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Deleted volume successfully. Jul 01 04:06:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5c721cf3-5239-48b6-9459-46b448e57a62 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-b447c6c6-b8d3-4d99-ab93-7b4bff4e761d-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:06:53 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-095895d7-74a5-48b9-8105-1df1cb57c4f6 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Retype volume completed successfully. Jul 01 04:06:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Acquiring lock "cinder-f3581164-5550-43d2-b25d-181c82c17653-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Lock "cinder-f3581164-5550-43d2-b25d-181c82c17653-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Acquiring lock "cinder-quobyte-f3581164-5550-43d2-b25d-181c82c17653" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Lock "cinder-quobyte-f3581164-5550-43d2-b25d-181c82c17653" acquired by "delete_volume" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:53 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bbd1f0-1136-4052-af3f-2bf6bad661af]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:06:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3581164-5550-43d2-b25d-181c82c17653 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:54 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3581164-5550-43d2-b25d-181c82c17653 Jul 01 04:06:54 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Flow 'volume_create_manager' (d959b5fb-1ee6-4238-96ff-a50a027d07fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05511916-2864-481c-9788-ce818c510d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05511916-2864-481c-9788-ce818c510d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-810981672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5997ca-c57f-4c48-9d0a-5a7720133ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d93025f46c645438c8ea92725b7c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:06:54Z,use_quota=True,user_id='455a8506e47d440ebb1a95775621b084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acddfef7-d32e-4962-ae42-69510a67b15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acddfef7-d32e-4962-ae42-69510a67b15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767bbb6a-e264-4b36-b183-3ba2d374844e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767bbb6a-e264-4b36-b183-3ba2d374844e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d5997ca-c57f-4c48-9d0a-5a7720133ae2', 'volume_name': 'volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d297fbd-edb6-4865-bb82-7d1c0156ec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d297fbd-edb6-4865-bb82-7d1c0156ec41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab718f9-5603-4e6b-8b9c-ae85393008f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:54 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Volume 8d5997ca-c57f-4c48-9d0a-5a7720133ae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2', 'volume_size': 1} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-810981672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5997ca-c57f-4c48-9d0a-5a7720133ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d93025f46c645438c8ea92725b7c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:06:54Z,use_quota=True,user_id='455a8506e47d440ebb1a95775621b084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Creating volume 8d5997ca-c57f-4c48-9d0a-5a7720133ae2 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:06:54 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:06:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:54 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2 1073741824 Jul 01 04:06:54 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:55 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3581164-5550-43d2-b25d-181c82c17653" returned: 0 in 1.135s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3581164-5550-43d2-b25d-181c82c17653 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:55 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3581164-5550-43d2-b25d-181c82c17653 Jul 01 04:06:55 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:55 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2 1073741824" returned: 0 in 1.159s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:55 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2 Jul 01 04:06:55 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:55 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3581164-5550-43d2-b25d-181c82c17653" returned: 0 in 0.860s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Lock "cinder-quobyte-f3581164-5550-43d2-b25d-181c82c17653" released by "delete_volume" :: held 2.059s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:06:56 devstack cinder-volume[86177]: WARNING cinder.quota [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:06:56 devstack cinder-volume[86177]: WARNING cinder.quota [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Created reservations ['8de1a0d1-57bf-4eaf-a7f6-f953e9be6846', '64cac0c1-ebd8-4bd0-860b-aeca128bcb41', 'fc0bcee9-9dda-41eb-aea8-fc7f286f6ebd', '0ea63d7d-bc36-4dea-90d0-4b83dedd7b45'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:56 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:06:56 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:56 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2" returned: 0 in 0.857s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab718f9-5603-4e6b-8b9c-ae85393008f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a8c017-da88-4e7c-b220-53008d916ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:56 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Volume volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2 (8d5997ca-c57f-4c48-9d0a-5a7720133ae2): created successfully Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a8c017-da88-4e7c-b220-53008d916ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Flow 'volume_create_manager' (d959b5fb-1ee6-4238-96ff-a50a027d07fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:06:56 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-226a39f2-0a7b-427a-bb8c-8f486442a35b tempest-VolumesActionsTest-869694445 None] Created volume successfully. Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Flow 'volume_create_manager' (810bc8d6-26b2-4513-a6e4-4f083c4f4685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346b028c-bda9-42bd-9906-de973c160c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346b028c-bda9-42bd-9906-de973c160c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1607834137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1b865c-9310-409f-b457-8e96534e962c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9fd7ad49894f618f35158c09304af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:06:57Z,use_quota=True,user_id='f21f66251a0a4129ad190217f82c6d83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0200b2ae-f121-4b4c-83dd-c137231602e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0200b2ae-f121-4b4c-83dd-c137231602e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cbb34b-e7f0-4ba0-9ac3-4a392e6e640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cbb34b-e7f0-4ba0-9ac3-4a392e6e640a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e1b865c-9310-409f-b457-8e96534e962c', 'volume_name': 'volume-9e1b865c-9310-409f-b457-8e96534e962c', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6beb7b26-f83e-495a-9743-b7180cbeeda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6beb7b26-f83e-495a-9743-b7180cbeeda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6849ced-02bf-43ea-bbfb-586ed8ab60fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:56 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Volume 9e1b865c-9310-409f-b457-8e96534e962c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e1b865c-9310-409f-b457-8e96534e962c', 'volume_size': 1} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1607834137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1b865c-9310-409f-b457-8e96534e962c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9fd7ad49894f618f35158c09304af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:06:57Z,use_quota=True,user_id='f21f66251a0a4129ad190217f82c6d83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Creating volume 9e1b865c-9310-409f-b457-8e96534e962c {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:06:56 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:06:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9e1b865c-9310-409f-b457-8e96534e962c 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:56 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9e1b865c-9310-409f-b457-8e96534e962c 1073741824 Jul 01 04:06:56 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:57 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.794s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:57 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:06:57 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Deleted volume successfully. Jul 01 04:06:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d344df1c-01c3-47ee-a0b8-e915c9d03563 tempest-VolumeRetypeWithoutMigrationTest-882086046 None] Lock "cinder-f3581164-5550-43d2-b25d-181c82c17653-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:06:57 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Acquiring lock "cinder-8d5997ca-c57f-4c48-9d0a-5a7720133ae2-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9e1b865c-9310-409f-b457-8e96534e962c 1073741824" returned: 0 in 1.112s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-8d5997ca-c57f-4c48-9d0a-5a7720133ae2-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9e1b865c-9310-409f-b457-8e96534e962c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:58 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9e1b865c-9310-409f-b457-8e96534e962c Jul 01 04:06:58 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:58 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Acquiring lock "cinder-quobyte-8d5997ca-c57f-4c48-9d0a-5a7720133ae2" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:06:58 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-quobyte-8d5997ca-c57f-4c48-9d0a-5a7720133ae2" acquired by "delete_volume" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:06:58 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7e7b03-cc33-42ef-a017-2171f194c995]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:06:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:58 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2 Jul 01 04:06:58 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:06:59 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9e1b865c-9310-409f-b457-8e96534e962c" returned: 0 in 1.121s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] <== create_volume: return (2317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:06:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.323s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:06:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6849ced-02bf-43ea-bbfb-586ed8ab60fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1b865c-9310-409f-b457-8e96534e962c', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b6da4f-d281-4d31-b7e6-0403546e6046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:06:59 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Volume volume-9e1b865c-9310-409f-b457-8e96534e962c (9e1b865c-9310-409f-b457-8e96534e962c): created successfully Jul 01 04:06:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b6da4f-d281-4d31-b7e6-0403546e6046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:06:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Flow 'volume_create_manager' (810bc8d6-26b2-4513-a6e4-4f083c4f4685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:06:59 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-b083627d-39e5-4809-852e-9439b4a518fb tempest-TestMinimumBasicScenario-1764713216 None] Created volume successfully. Jul 01 04:06:59 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Jul 01 04:06:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2" returned: 0 in 1.464s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:06:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:06:59 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2 Jul 01 04:06:59 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:00 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8d5997ca-c57f-4c48-9d0a-5a7720133ae2" returned: 0 in 0.992s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-quobyte-8d5997ca-c57f-4c48-9d0a-5a7720133ae2" released by "delete_volume" :: held 2.518s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:00 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Created reservations ['616ffc28-304c-4a3d-9824-25da1291e956', 'ff6b1700-d056-4f90-9df5-d475b8a2f09b', 'b9c3bef6-f498-4f45-b93b-009757187a97', 'd02ee131-10ae-4beb-a447-17a222827996'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:07:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:07:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:07:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:00 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:07:00 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:01 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.087s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:01 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:07:01 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Deleted volume successfully. Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d2932ce6-2015-4aff-8f00-ce12a66d6114 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-8d5997ca-c57f-4c48-9d0a-5a7720133ae2-delete_volume" released by "delete_volume" :: held 4.083s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Flow 'volume_create_manager' (103edc4c-c095-4daf-9b02-3d3b2d91b912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01be6d2e-deea-45ce-9084-4c05d3e250f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01be6d2e-deea-45ce-9084-4c05d3e250f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-704750512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb18cdf-72ff-475f-8771-0a3f3d24c23f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d93025f46c645438c8ea92725b7c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:07:02Z,use_quota=True,user_id='455a8506e47d440ebb1a95775621b084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc27f74-1fb5-4941-a2b8-341436308cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc27f74-1fb5-4941-a2b8-341436308cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b99561-c50e-458d-afe8-06889de4ef6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b99561-c50e-458d-afe8-06889de4ef6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bb18cdf-72ff-475f-8771-0a3f3d24c23f', 'volume_name': 'volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed142b2f-7801-4a6c-b50c-d7a9de4c48c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed142b2f-7801-4a6c-b50c-d7a9de4c48c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a282149a-b032-4212-977b-e68a2fedac06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:02 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Volume 9bb18cdf-72ff-475f-8771-0a3f3d24c23f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f', 'volume_size': 1} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-704750512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb18cdf-72ff-475f-8771-0a3f3d24c23f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d93025f46c645438c8ea92725b7c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:07:02Z,use_quota=True,user_id='455a8506e47d440ebb1a95775621b084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Creating volume 9bb18cdf-72ff-475f-8771-0a3f3d24c23f {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:07:02 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:02 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f 1073741824 Jul 01 04:07:02 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Flow 'volume_create_manager' (14656f1c-fed0-41f7-9517-e6a4fe5fe63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2dd1b2f-7b1f-4443-9a6d-f428a9ff1894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2dd1b2f-7b1f-4443-9a6d-f428a9ff1894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-469054832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04746bbf-62d9-4aa0-b8c8-664686e50e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63fe91280dd4f1f9dca098494a074f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:07:03Z,use_quota=True,user_id='3714d7b4ace44918b49d8667427293f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db85f40-a52e-4f71-abd5-9211a5b83aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db85f40-a52e-4f71-abd5-9211a5b83aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3706a8e-9e55-4be8-9c67-b6aee7176bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3706a8e-9e55-4be8-9c67-b6aee7176bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04746bbf-62d9-4aa0-b8c8-664686e50e2e', 'volume_name': 'volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5fec45f-d652-44e2-bdbd-e34c3195cf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5fec45f-d652-44e2-bdbd-e34c3195cf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e000ed-fdee-4655-af24-7b2b3fb0bacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:02 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Volume 04746bbf-62d9-4aa0-b8c8-664686e50e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e', 'volume_size': 1} Jul 01 04:07:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:03 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f 1073741824" returned: 0 in 1.183s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:03 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f Jul 01 04:07:03 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-68d585ab-7922-48ab-8813-138893aea467 req-7c8e7cbb-b4ff-419c-8241-8758da694ec0 tempest-TestMinimumBasicScenario-1764713216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:04 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f" returned: 0 in 0.759s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.726s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-469054832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04746bbf-62d9-4aa0-b8c8-664686e50e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63fe91280dd4f1f9dca098494a074f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:07:03Z,use_quota=True,user_id='3714d7b4ace44918b49d8667427293f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Creating volume 04746bbf-62d9-4aa0-b8c8-664686e50e2e {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:07:04 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a282149a-b032-4212-977b-e68a2fedac06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2daa1fcf-b96e-4fc5-8061-6d86b63061ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:04 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e 1073741824 Jul 01 04:07:04 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:04 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Volume volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f (9bb18cdf-72ff-475f-8771-0a3f3d24c23f): created successfully Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2daa1fcf-b96e-4fc5-8061-6d86b63061ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Flow 'volume_create_manager' (103edc4c-c095-4daf-9b02-3d3b2d91b912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:07:04 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-3a0a80c2-0ebb-4bbe-80fb-d37acfb1ee15 tempest-VolumesActionsTest-869694445 None] Created volume successfully. Jul 01 04:07:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Acquiring lock "cinder-9bb18cdf-72ff-475f-8771-0a3f3d24c23f-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-9bb18cdf-72ff-475f-8771-0a3f3d24c23f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:05 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e 1073741824" returned: 0 in 1.176s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Acquiring lock "cinder-quobyte-9bb18cdf-72ff-475f-8771-0a3f3d24c23f" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-quobyte-9bb18cdf-72ff-475f-8771-0a3f3d24c23f" acquired by "delete_volume" :: waited 0.049s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:06 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e Jul 01 04:07:06 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:06 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebd0290-41b8-4d71-953c-99347bc71e9d]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:06 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f Jul 01 04:07:06 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:06 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e" returned: 0 in 0.976s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] <== create_volume: return (2264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:07:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.269s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-68d585ab-7922-48ab-8813-138893aea467 req-7c8e7cbb-b4ff-419c-8241-8758da694ec0 tempest-TestMinimumBasicScenario-1764713216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.791s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:07 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e000ed-fdee-4655-af24-7b2b3fb0bacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:07 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c140dc-79e3-4c80-b2ac-6bafd2b680b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:07 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be4c848-748b-4601-ae20-956c8fcf083e]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-68d585ab-7922-48ab-8813-138893aea467 req-7c8e7cbb-b4ff-419c-8241-8758da694ec0 tempest-TestMinimumBasicScenario-1764713216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9e1b865c-9310-409f-b457-8e96534e962c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:07 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Volume volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e (04746bbf-62d9-4aa0-b8c8-664686e50e2e): created successfully Jul 01 04:07:07 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c140dc-79e3-4c80-b2ac-6bafd2b680b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:07 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Flow 'volume_create_manager' (14656f1c-fed0-41f7-9517-e6a4fe5fe63f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:07:07 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-bf924307-cb79-45c7-be86-072fcb7554fb tempest-AttachVolumeNegativeTest-962019476 None] Created volume successfully. Jul 01 04:07:07 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f" returned: 0 in 1.049s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:07 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9e1b865c-9310-409f-b457-8e96534e962c Jul 01 04:07:07 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:07 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f Jul 01 04:07:07 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:07 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9bb18cdf-72ff-475f-8771-0a3f3d24c23f" returned: 0 in 0.783s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:07 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-68d585ab-7922-48ab-8813-138893aea467 req-7c8e7cbb-b4ff-419c-8241-8758da694ec0 tempest-TestMinimumBasicScenario-1764713216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9e1b865c-9310-409f-b457-8e96534e962c" returned: 0 in 0.925s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-68d585ab-7922-48ab-8813-138893aea467 req-7c8e7cbb-b4ff-419c-8241-8758da694ec0 tempest-TestMinimumBasicScenario-1764713216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.963s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-quobyte-9bb18cdf-72ff-475f-8771-0a3f3d24c23f" released by "delete_volume" :: held 1.935s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-68d585ab-7922-48ab-8813-138893aea467 req-7c8e7cbb-b4ff-419c-8241-8758da694ec0 tempest-TestMinimumBasicScenario-1764713216 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-9e1b865c-9310-409f-b457-8e96534e962c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81bafb81-aeb7-45d4-8bbd-fc2dce306ce9', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:07:08 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Created reservations ['ea07bd92-b7d6-498a-a5ff-ff6b3cfc25ef', '58dba995-16ed-4273-88fc-05be735eb914', 'fdef5da9-5b50-4d27-b22e-d8edb6903236', 'ffea7323-0d0c-460e-95f6-ff1fcd00bbb9'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:07:08 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-68d585ab-7922-48ab-8813-138893aea467 req-7c8e7cbb-b4ff-419c-8241-8758da694ec0 tempest-TestMinimumBasicScenario-1764713216 None] attachment_update completed successfully. Jul 01 04:07:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:07:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:07:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:08 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:07:08 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:08 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.746s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:08 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:07:08 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Deleted volume successfully. Jul 01 04:07:08 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a62f3cd7-61f8-42cb-b756-ce521d80ae06 tempest-VolumesActionsTest-1725792442 None] Lock "cinder-9bb18cdf-72ff-475f-8771-0a3f3d24c23f-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Flow 'volume_create_manager' (c904706c-ccea-4aca-a59d-533b22adad9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb2c654-4685-43b2-80ce-c928b90f3fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb2c654-4685-43b2-80ce-c928b90f3fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-55362344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb44e81-ded7-4c36-9b81-d143a304c2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d93025f46c645438c8ea92725b7c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:07:10Z,use_quota=True,user_id='455a8506e47d440ebb1a95775621b084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5889d455-7036-41df-8009-fb6892509d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5889d455-7036-41df-8009-fb6892509d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4266da52-188d-4384-b844-fccc1449c703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4266da52-188d-4384-b844-fccc1449c703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb44e81-ded7-4c36-9b81-d143a304c2a9', 'volume_name': 'volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc71b65f-7b1a-4ee5-a645-6841e1f637d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc71b65f-7b1a-4ee5-a645-6841e1f637d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7572f25-683b-4c80-bb3f-c80c97945db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:09 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Volume 0cb44e81-ded7-4c36-9b81-d143a304c2a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9', 'volume_size': 1} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-55362344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb44e81-ded7-4c36-9b81-d143a304c2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d93025f46c645438c8ea92725b7c000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:07:10Z,use_quota=True,user_id='455a8506e47d440ebb1a95775621b084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Creating volume 0cb44e81-ded7-4c36-9b81-d143a304c2a9 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:07:09 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:07:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:09 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9 1073741824 Jul 01 04:07:09 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:10 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9 1073741824" returned: 0 in 0.915s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:10 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9 Jul 01 04:07:10 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-995e5681-6993-4149-ab70-a426e9ede9b9 req-a9c2a556-dc9e-4b96-8d1f-3d1ba8f81b7c tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Flow 'volume_create_manager' (d6807ef0-b38e-4392-8d80-602b6ebde0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87cfdb6-d25a-42eb-93fd-d0c0370ecce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87cfdb6-d25a-42eb-93fd-d0c0370ecce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-948312094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72b42e6-439b-432f-8cb8-88ac77ebe03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184fd0575ffe4b128fb8f230eff4f7dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:07:11Z,use_quota=True,user_id='4db4b3ee7e0d40f2acc300a9374395e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf944f26-6a41-4df3-8a37-208bc616a9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf944f26-6a41-4df3-8a37-208bc616a9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80c9ad0-4902-4245-9865-53d862455195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80c9ad0-4902-4245-9865-53d862455195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b72b42e6-439b-432f-8cb8-88ac77ebe03b', 'volume_name': 'volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c3675e-394c-498e-b092-e436ab871d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c3675e-394c-498e-b092-e436ab871d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81182c04-c148-4c07-a018-bcb26a83a60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:11 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Volume b72b42e6-439b-432f-8cb8-88ac77ebe03b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b', 'volume_size': 1} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:11 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9" returned: 0 in 0.718s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-995e5681-6993-4149-ab70-a426e9ede9b9 req-a9c2a556-dc9e-4b96-8d1f-3d1ba8f81b7c tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.532s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7572f25-683b-4c80-bb3f-c80c97945db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a38fb7-2531-4e55-b0bc-af4ed905cdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f4a081-66cb-48b5-ba70-60aa32855d41]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-995e5681-6993-4149-ab70-a426e9ede9b9 req-a9c2a556-dc9e-4b96-8d1f-3d1ba8f81b7c tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:11 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Volume volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9 (0cb44e81-ded7-4c36-9b81-d143a304c2a9): created successfully Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a38fb7-2531-4e55-b0bc-af4ed905cdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Flow 'volume_create_manager' (c904706c-ccea-4aca-a59d-533b22adad9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:07:11 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-000d34b9-c81f-4b5b-95e9-3c66275b6a25 tempest-VolumesActionsTest-869694445 None] Created volume successfully. Jul 01 04:07:11 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e Jul 01 04:07:11 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:12 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-995e5681-6993-4149-ab70-a426e9ede9b9 req-a9c2a556-dc9e-4b96-8d1f-3d1ba8f81b7c tempest-AttachVolumeNegativeTest-962019476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e" returned: 0 in 0.876s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-995e5681-6993-4149-ab70-a426e9ede9b9 req-a9c2a556-dc9e-4b96-8d1f-3d1ba8f81b7c tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.916s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.026s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-948312094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72b42e6-439b-432f-8cb8-88ac77ebe03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184fd0575ffe4b128fb8f230eff4f7dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:07:11Z,use_quota=True,user_id='4db4b3ee7e0d40f2acc300a9374395e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Creating volume b72b42e6-439b-432f-8cb8-88ac77ebe03b {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:07:12 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:12 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b 1073741824 Jul 01 04:07:12 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-995e5681-6993-4149-ab70-a426e9ede9b9 req-a9c2a556-dc9e-4b96-8d1f-3d1ba8f81b7c tempest-AttachVolumeNegativeTest-962019476 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'faef23e3-90f1-451e-ab52-48f6d936a564', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:07:12 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-995e5681-6993-4149-ab70-a426e9ede9b9 req-a9c2a556-dc9e-4b96-8d1f-3d1ba8f81b7c tempest-AttachVolumeNegativeTest-962019476 None] attachment_update completed successfully. Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Acquiring lock "cinder-0cb44e81-ded7-4c36-9b81-d143a304c2a9-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Lock "cinder-0cb44e81-ded7-4c36-9b81-d143a304c2a9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:12 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Acquiring lock "cinder-quobyte-0cb44e81-ded7-4c36-9b81-d143a304c2a9" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Lock "cinder-quobyte-0cb44e81-ded7-4c36-9b81-d143a304c2a9" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:13 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5a6f75-215f-4b03-a27c-6723571578b0]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:13 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9 Jul 01 04:07:13 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:13 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b 1073741824" returned: 0 in 1.203s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:13 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b Jul 01 04:07:13 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:14 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9" returned: 0 in 1.118s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:14 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9 Jul 01 04:07:14 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:14 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b" returned: 0 in 0.755s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81182c04-c148-4c07-a018-bcb26a83a60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4263cbe8-cafd-41ea-b994-9390f2c060c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:14 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Volume volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b (b72b42e6-439b-432f-8cb8-88ac77ebe03b): created successfully Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4263cbe8-cafd-41ea-b994-9390f2c060c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Flow 'volume_create_manager' (d6807ef0-b38e-4392-8d80-602b6ebde0a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:07:14 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-955af269-f034-4aaa-a144-d10308212589 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Created volume successfully. Jul 01 04:07:14 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0cb44e81-ded7-4c36-9b81-d143a304c2a9" returned: 0 in 0.664s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Lock "cinder-quobyte-0cb44e81-ded7-4c36-9b81-d143a304c2a9" released by "delete_volume" :: held 1.834s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Created reservations ['8ae0763a-d345-4b36-a16d-0fd05c700266', 'd1e539dd-8b99-4b07-a270-acff7a4930ac', '8db1464b-ab14-46b2-9dca-49e4974184fb', 'c682f3f4-b563-45c3-9870-91532e6068ce'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:14 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:07:14 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:15 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.720s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:15 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:07:15 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Deleted volume successfully. Jul 01 04:07:15 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7969d500-c601-4f30-b659-6c0ee15f1899 tempest-VolumesActionsTest-869694445 None] Lock "cinder-0cb44e81-ded7-4c36-9b81-d143a304c2a9-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Creating offline snapshot cd3e5f98-8932-450c-a934-7cc27c7842aa of volume b72b42e6-439b-432f-8cb8-88ac77ebe03b {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:07:15 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[664ec996-404e-43c7-bbe9-191bf9800114]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:16 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b Jul 01 04:07:16 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:16 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b" returned: 0 in 0.901s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:16 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa 1G Jul 01 04:07:16 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:18 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa 1G" returned: 0 in 1.299s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:18 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa Jul 01 04:07:18 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:19 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa" returned: 0 in 0.946s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:19 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa is being set with open permissions: ugo+rw Jul 01 04:07:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:19 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa Jul 01 04:07:19 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:19 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-5f2caee3-076b-4326-9c3c-43e694a2b1e5 req-daf62e81-4a14-44b5-bd56-b64149f13c30 tempest-AttachVolumeNegativeTest-962019476 None] Terminate volume connection completed successfully. Jul 01 04:07:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-5f2caee3-076b-4326-9c3c-43e694a2b1e5 req-daf62e81-4a14-44b5-bd56-b64149f13c30 tempest-AttachVolumeNegativeTest-962019476 None] Deleting attachment faef23e3-90f1-451e-ab52-48f6d936a564. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:07:19 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa" returned: 0 in 0.783s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:19 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.info Jul 01 04:07:19 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:20 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.info" returned: 0 in 0.753s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:20 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.info is being set with open permissions: ugo+rw Jul 01 04:07:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:20 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.info Jul 01 04:07:20 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:21 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.info" returned: 0 in 0.854s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.692s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:21 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-67944b01-fb50-4867-8303-6fcb41fca7db tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Create snapshot completed successfully Jul 01 04:07:22 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Acquiring lock "cinder-cd3e5f98-8932-450c-a934-7cc27c7842aa-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:22 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "cinder-cd3e5f98-8932-450c-a934-7cc27c7842aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:22 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Acquiring lock "cinder-quobyte-b72b42e6-439b-432f-8cb8-88ac77ebe03b" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:22 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "cinder-quobyte-b72b42e6-439b-432f-8cb8-88ac77ebe03b" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:22 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Acquiring lock "cinder-quobyte-cd3e5f98-8932-450c-a934-7cc27c7842aa" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:22 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "cinder-quobyte-cd3e5f98-8932-450c-a934-7cc27c7842aa" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Deleting offline snapshot cd3e5f98-8932-450c-a934-7cc27c7842aa of volume b72b42e6-439b-432f-8cb8-88ac77ebe03b {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:07:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] snapshot_file for this snap is: volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:07:22 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a8857a-c22e-4f0c-be0b-d5335d423643]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:23 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa Jul 01 04:07:23 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:24 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa" returned: 0 in 1.000s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:07:24 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bc1544-0fae-4ad5-8496-d06405ff718f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:24 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b Jul 01 04:07:24 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:07:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:07:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:07:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:24 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:07:24 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:25 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b" returned: 0 in 0.975s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:25 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa Jul 01 04:07:25 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:25 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.890s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:07:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:07:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:07:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:07:26 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa" returned: 0 in 1.030s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:26 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa Jul 01 04:07:26 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:26 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b.cd3e5f98-8932-450c-a934-7cc27c7842aa" returned: 0 in 0.776s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "cinder-quobyte-cd3e5f98-8932-450c-a934-7cc27c7842aa" released by "_delete_snapshot" :: held 4.010s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "cinder-quobyte-b72b42e6-439b-432f-8cb8-88ac77ebe03b" released by "delete_snapshot" :: held 4.051s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:26 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Created reservations ['04c21003-10a3-4d56-b304-0cb21fc03585', 'f8d4a04a-96cc-4e81-8673-3714c6605d7e', 'a9389aff-2df0-4187-9a27-cbd1ed63eab7', 'b76010d9-dc9a-49dc-ac66-9d2a7782db82'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:07:27 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Delete snapshot completed successfully. Jul 01 04:07:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cecc141e-1290-4690-9b00-4ede5c058433 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "cinder-cd3e5f98-8932-450c-a934-7cc27c7842aa-delete_snapshot" released by "delete_snapshot" :: held 4.258s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Acquiring lock "cinder-b72b42e6-439b-432f-8cb8-88ac77ebe03b-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "cinder-b72b42e6-439b-432f-8cb8-88ac77ebe03b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Acquiring lock "cinder-quobyte-b72b42e6-439b-432f-8cb8-88ac77ebe03b" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "cinder-quobyte-b72b42e6-439b-432f-8cb8-88ac77ebe03b" acquired by "delete_volume" :: waited 0.032s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:28 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01b7c22-716b-4c6d-b369-757a95d041d1]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:28 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b Jul 01 04:07:28 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:28 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Flow 'volume_create_manager' (060d0015-91f2-4d66-9806-d822f29f1fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8581d2-4fe7-45f3-95a2-f5d196cf5977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8581d2-4fe7-45f3-95a2-f5d196cf5977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-262117091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fcb114f-7181-4710-9e3b-8a3db648a988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03dbf2ca5994c6eaced9f48f255bbae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:07:29Z,use_quota=True,user_id='ae931f5684e14db4ba19979f3e4dfc37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda4fdf6-6378-4467-a814-6fb0d94eea22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda4fdf6-6378-4467-a814-6fb0d94eea22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8950bec0-dff5-417b-98d2-0477526c5353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8950bec0-dff5-417b-98d2-0477526c5353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fcb114f-7181-4710-9e3b-8a3db648a988', 'volume_name': 'volume-1fcb114f-7181-4710-9e3b-8a3db648a988', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491d18ca-0906-4df9-9249-390bff91cf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491d18ca-0906-4df9-9249-390bff91cf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c0dff9-5ebf-4dfa-abb0-8d50c2bf3043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:29 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Volume 1fcb114f-7181-4710-9e3b-8a3db648a988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fcb114f-7181-4710-9e3b-8a3db648a988', 'volume_size': 1} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-262117091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fcb114f-7181-4710-9e3b-8a3db648a988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03dbf2ca5994c6eaced9f48f255bbae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:07:29Z,use_quota=True,user_id='ae931f5684e14db4ba19979f3e4dfc37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Creating volume 1fcb114f-7181-4710-9e3b-8a3db648a988 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:07:29 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:29 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:29 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 1073741824 Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b" returned: 0 in 0.805s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:29 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:29 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b Jul 01 04:07:29 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:29 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b72b42e6-439b-432f-8cb8-88ac77ebe03b" returned: 0 in 0.759s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "cinder-quobyte-b72b42e6-439b-432f-8cb8-88ac77ebe03b" released by "delete_volume" :: held 1.631s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:29 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Created reservations ['e2ef258b-6f65-4855-815d-0c237154c7c4', 'caffaaf7-33d1-4c2c-82ea-66884a06fc4e', '80e8516f-cc3b-40d7-ae98-630035e84619', '7a943ca0-582a-47d1-88d0-37dd321b90e8'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:07:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:07:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:07:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:30 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:07:30 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:30 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 1073741824" returned: 0 in 1.005s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:30 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 Jul 01 04:07:30 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:30 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.864s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:30 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:07:30 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Deleted volume successfully. Jul 01 04:07:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-30515497-0ae5-402c-b1bd-4afa108ab8c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-644607044 None] Lock "cinder-b72b42e6-439b-432f-8cb8-88ac77ebe03b-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988" returned: 0 in 0.868s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:07:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:30 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c0dff9-5ebf-4dfa-abb0-8d50c2bf3043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fcb114f-7181-4710-9e3b-8a3db648a988', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29955078-f431-4291-9a4b-3aee65c41603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:31 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Volume volume-1fcb114f-7181-4710-9e3b-8a3db648a988 (1fcb114f-7181-4710-9e3b-8a3db648a988): created successfully Jul 01 04:07:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29955078-f431-4291-9a4b-3aee65c41603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Flow 'volume_create_manager' (060d0015-91f2-4d66-9806-d822f29f1fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:07:31 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-3739a298-971d-47a4-a80a-2954719c1ed8 tempest-VolumesDeleteCascade-683448675 None] Created volume successfully. Jul 01 04:07:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] Creating offline snapshot 7ea8e37f-819b-46f4-8a46-92dcdd56b724 of volume 1fcb114f-7181-4710-9e3b-8a3db648a988 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:07:32 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6743641e-1a47-4fd3-b38d-e43b706048f0]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:32 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 Jul 01 04:07:32 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:33 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988" returned: 0 in 0.911s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:33 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 1G Jul 01 04:07:33 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:34 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 1G" returned: 0 in 1.029s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcb114f-7181-4710-9e3b-8a3db648a988 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:34 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcb114f-7181-4710-9e3b-8a3db648a988 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 Jul 01 04:07:34 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:35 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcb114f-7181-4710-9e3b-8a3db648a988 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724" returned: 0 in 0.709s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:35 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 is being set with open permissions: ugo+rw Jul 01 04:07:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:35 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 Jul 01 04:07:35 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:35 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724" returned: 0 in 0.735s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:35 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.info Jul 01 04:07:35 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:36 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.info" returned: 0 in 0.737s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:36 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.info is being set with open permissions: ugo+rw Jul 01 04:07:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:36 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.info Jul 01 04:07:36 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=95,cinder:UPDATE=108,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:07:37 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.info" returned: 0 in 0.719s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.944s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Flow 'volume_create_manager' (cd22b585-1c60-4857-9f12-b8e7e3b951dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6f5464-4b92-4ec4-8e2e-132e5fd11978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:37 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-26aabb10-b9cc-490c-93d4-84c53c397a10 tempest-VolumesDeleteCascade-683448675 None] Create snapshot completed successfully Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6f5464-4b92-4ec4-8e2e-132e5fd11978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1104781087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b60e7cd9-5147-401c-adb6-839dd815ed72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd92b8a4b2944d29e897bdadbd9f126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:07:37Z,use_quota=True,user_id='6383d064bfc64ccc99f700091ce06696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a240980f-9b69-4f6a-84e3-6f593db5ab0f),volume_type_id=a240980f-9b69-4f6a-84e3-6f593db5ab0f)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b973c02a-7f06-40ef-ae95-3244c832bdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b973c02a-7f06-40ef-ae95-3244c832bdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79775031-10c8-4e28-9465-27d91ba19b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79775031-10c8-4e28-9465-27d91ba19b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b60e7cd9-5147-401c-adb6-839dd815ed72', 'volume_name': 'volume-b60e7cd9-5147-401c-adb6-839dd815ed72', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ce1f09-9168-4751-a141-d3a1eebbe6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ce1f09-9168-4751-a141-d3a1eebbe6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70402cfa-5dbb-4154-9bdd-d29e3c80594f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:37 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Volume b60e7cd9-5147-401c-adb6-839dd815ed72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b60e7cd9-5147-401c-adb6-839dd815ed72', 'volume_size': 1} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1104781087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b60e7cd9-5147-401c-adb6-839dd815ed72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd92b8a4b2944d29e897bdadbd9f126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:07:37Z,use_quota=True,user_id='6383d064bfc64ccc99f700091ce06696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a240980f-9b69-4f6a-84e3-6f593db5ab0f),volume_type_id=a240980f-9b69-4f6a-84e3-6f593db5ab0f)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Creating volume b60e7cd9-5147-401c-adb6-839dd815ed72 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:07:37 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b60e7cd9-5147-401c-adb6-839dd815ed72 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:37 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b60e7cd9-5147-401c-adb6-839dd815ed72 1073741824 Jul 01 04:07:37 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9b8c61ac-fc4b-44b4-a49d-fac57026b701 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:38 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b60e7cd9-5147-401c-adb6-839dd815ed72 1073741824" returned: 0 in 1.513s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:39 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=83,cinder:UPDATE=98,cinder:DELETE=14,cinder:INSERT=27 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:07:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b60e7cd9-5147-401c-adb6-839dd815ed72 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:39 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b60e7cd9-5147-401c-adb6-839dd815ed72 Jul 01 04:07:39 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:40 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b60e7cd9-5147-401c-adb6-839dd815ed72" returned: 0 in 1.151s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] <== create_volume: return (2781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:07:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.784s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9b8c61ac-fc4b-44b4-a49d-fac57026b701 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.341s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70402cfa-5dbb-4154-9bdd-d29e3c80594f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b60e7cd9-5147-401c-adb6-839dd815ed72', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc5bbfe-bd49-40da-bf71-eb25211ef3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:07:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-9b8c61ac-fc4b-44b4-a49d-fac57026b701 tempest-VolumesDeleteCascade-683448675 None] Creating offline snapshot b1ed7411-2870-42a1-9e89-c66308607f33 of volume 1fcb114f-7181-4710-9e3b-8a3db648a988 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:07:40 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Volume volume-b60e7cd9-5147-401c-adb6-839dd815ed72 (b60e7cd9-5147-401c-adb6-839dd815ed72): created successfully Jul 01 04:07:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc5bbfe-bd49-40da-bf71-eb25211ef3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:07:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Flow 'volume_create_manager' (cd22b585-1c60-4857-9f12-b8e7e3b951dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:07:40 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fe921f-2d0f-4eb0-ab76-aae30789d7bf]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b8c61ac-fc4b-44b4-a49d-fac57026b701 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:40 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-e6d3dc8d-ec37-4f71-ba72-1c6554af89d1 tempest-VolumeTypesAccessTest-873590943 None] Created volume successfully. Jul 01 04:07:40 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 Jul 01 04:07:40 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:41 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Acquiring lock "cinder-b60e7cd9-5147-401c-adb6-839dd815ed72-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:41 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Lock "cinder-b60e7cd9-5147-401c-adb6-839dd815ed72-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:41 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Acquiring lock "cinder-quobyte-b60e7cd9-5147-401c-adb6-839dd815ed72" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:41 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Lock "cinder-quobyte-b60e7cd9-5147-401c-adb6-839dd815ed72" acquired by "delete_volume" :: waited 0.048s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:41 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8009814a-826f-49bb-a8f4-29a4261f3801]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b60e7cd9-5147-401c-adb6-839dd815ed72 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:41 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b60e7cd9-5147-401c-adb6-839dd815ed72 Jul 01 04:07:41 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:42 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b8c61ac-fc4b-44b4-a49d-fac57026b701 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724" returned: 0 in 2.096s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-9b8c61ac-fc4b-44b4-a49d-fac57026b701 tempest-VolumesDeleteCascade-683448675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fcb114f-7181-4710-9e3b-8a3db648a988(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:07:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b8c61ac-fc4b-44b4-a49d-fac57026b701 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:42 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 1G Jul 01 04:07:42 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:43 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b60e7cd9-5147-401c-adb6-839dd815ed72" returned: 0 in 1.826s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b60e7cd9-5147-401c-adb6-839dd815ed72 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:43 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b60e7cd9-5147-401c-adb6-839dd815ed72 Jul 01 04:07:43 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:44 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b8c61ac-fc4b-44b4-a49d-fac57026b701 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 1G" returned: 0 in 1.617s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b8c61ac-fc4b-44b4-a49d-fac57026b701 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:44 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 Jul 01 04:07:44 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:44 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b60e7cd9-5147-401c-adb6-839dd815ed72" returned: 0 in 1.122s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Lock "cinder-quobyte-b60e7cd9-5147-401c-adb6-839dd815ed72" released by "delete_volume" :: held 3.053s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:44 devstack cinder-volume[86177]: WARNING cinder.quota [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-735906844 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-735906844, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:07:44 devstack cinder-volume[86177]: WARNING cinder.quota [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-735906844 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-735906844, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:07:44 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Created reservations ['bb512266-e7c2-47b0-bf66-e93e59a11bdc', '99414402-4f96-443f-8904-3d729b1d71d1', 'b101f9ce-42f4-46f3-9c73-79e3c9cdf228', '243dfeeb-8321-4524-a14e-368ae492cd34'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:07:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:07:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:07:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:07:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:07:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:44 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:07:44 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:45 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b8c61ac-fc4b-44b4-a49d-fac57026b701 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33" returned: 0 in 1.065s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:45 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-9b8c61ac-fc4b-44b4-a49d-fac57026b701 tempest-VolumesDeleteCascade-683448675 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 is being set with open permissions: ugo+rw Jul 01 04:07:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b8c61ac-fc4b-44b4-a49d-fac57026b701 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:45 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 Jul 01 04:07:45 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:45 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.084s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:45 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:07:45 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Deleted volume successfully. Jul 01 04:07:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-014bcc8b-2db0-43fe-bc54-5e5d7208d97e tempest-VolumeTypesAccessTest-873590943 None] Lock "cinder-b60e7cd9-5147-401c-adb6-839dd815ed72-delete_volume" released by "delete_volume" :: held 4.605s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:46 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b8c61ac-fc4b-44b4-a49d-fac57026b701 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33" returned: 0 in 0.796s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9b8c61ac-fc4b-44b4-a49d-fac57026b701 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.829s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:07:46 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-9b8c61ac-fc4b-44b4-a49d-fac57026b701 tempest-VolumesDeleteCascade-683448675 None] Create snapshot completed successfully Jul 01 04:07:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-1fcb114f-7181-4710-9e3b-8a3db648a988-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-1fcb114f-7181-4710-9e3b-8a3db648a988-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Performing cascade delete. {{(pid=86177) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 01 04:07:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-7ea8e37f-819b-46f4-8a46-92dcdd56b724-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-7ea8e37f-819b-46f4-8a46-92dcdd56b724-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-quobyte-1fcb114f-7181-4710-9e3b-8a3db648a988" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-1fcb114f-7181-4710-9e3b-8a3db648a988" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-quobyte-7ea8e37f-819b-46f4-8a46-92dcdd56b724" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-7ea8e37f-819b-46f4-8a46-92dcdd56b724" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Deleting offline snapshot 7ea8e37f-819b-46f4-8a46-92dcdd56b724 of volume 1fcb114f-7181-4710-9e3b-8a3db648a988 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:07:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] snapshot_file for this snap is: volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:07:46 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d640c60-7b8f-4f1c-bea9-6f036333a4ca]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:47 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 Jul 01 04:07:47 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:47 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724" returned: 0 in 0.967s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fcb114f-7181-4710-9e3b-8a3db648a988(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:07:47 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[753a4c38-1d47-486b-bf90-84919b4c604c]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:48 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 Jul 01 04:07:48 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:48 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988" returned: 0 in 0.910s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:48 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b97a17-253d-4618-a7f3-c8673c8aeac0]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:49 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 Jul 01 04:07:49 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:50 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33" returned: 0 in 1.979s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fcb114f-7181-4710-9e3b-8a3db648a988(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:07:50 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e6b302-c755-4964-b5eb-0ac6340c9604]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:51 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 Jul 01 04:07:51 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:52 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724" returned: 0 in 1.390s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fcb114f-7181-4710-9e3b-8a3db648a988(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:07:52 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcec3de-964d-40b1-9c51-9a1387d443b6]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:52 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 Jul 01 04:07:52 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:53 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988" returned: 0 in 1.541s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:53 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 Jul 01 04:07:53 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:55 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724" returned: 0 in 1.215s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:55 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724 Jul 01 04:07:55 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:55 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.7ea8e37f-819b-46f4-8a46-92dcdd56b724" returned: 0 in 0.740s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcb114f-7181-4710-9e3b-8a3db648a988 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 -F qcow2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:55 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcb114f-7181-4710-9e3b-8a3db648a988 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 -F qcow2 Jul 01 04:07:55 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:56 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcb114f-7181-4710-9e3b-8a3db648a988 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 -F qcow2" returned: 0 in 0.792s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-7ea8e37f-819b-46f4-8a46-92dcdd56b724" released by "_delete_snapshot" :: held 9.775s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-1fcb114f-7181-4710-9e3b-8a3db648a988" released by "delete_snapshot" :: held 9.803s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:56 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Created reservations ['d8e692b5-816e-4025-82f0-cbf64dd4a6e6', '4889dfb3-e476-4abb-9bcd-302883a56444', '680e4a8a-a84a-43a5-b655-1fe35753ce44', 'f055a71b-b794-4d23-8d0a-9783f98b9bd5'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:07:56 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Delete snapshot completed successfully. Jul 01 04:07:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-7ea8e37f-819b-46f4-8a46-92dcdd56b724-delete_snapshot" released by "delete_snapshot" :: held 10.004s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:07:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-b1ed7411-2870-42a1-9e89-c66308607f33-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-b1ed7411-2870-42a1-9e89-c66308607f33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-quobyte-1fcb114f-7181-4710-9e3b-8a3db648a988" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-1fcb114f-7181-4710-9e3b-8a3db648a988" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-quobyte-b1ed7411-2870-42a1-9e89-c66308607f33" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:07:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-b1ed7411-2870-42a1-9e89-c66308607f33" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:07:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Deleting offline snapshot b1ed7411-2870-42a1-9e89-c66308607f33 of volume 1fcb114f-7181-4710-9e3b-8a3db648a988 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:07:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] snapshot_file for this snap is: volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:07:56 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaa3a5b-4fdc-4aa6-9fbd-90ab6928629d]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:57 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 Jul 01 04:07:57 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:57 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33" returned: 0 in 0.928s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:57 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fcb114f-7181-4710-9e3b-8a3db648a988(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:07:57 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[811f5194-216a-4ef6-be60-2933220e5ba1]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:07:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:58 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 Jul 01 04:07:58 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:59 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988" returned: 0 in 1.070s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:59 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 Jul 01 04:07:59 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:07:59 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jul 01 04:07:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33" returned: 0 in 0.797s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:07:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:07:59 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33 Jul 01 04:07:59 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:00 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988.b1ed7411-2870-42a1-9e89-c66308607f33" returned: 0 in 0.719s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-b1ed7411-2870-42a1-9e89-c66308607f33" released by "_delete_snapshot" :: held 3.651s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-1fcb114f-7181-4710-9e3b-8a3db648a988" released by "delete_snapshot" :: held 3.706s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:00 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Created reservations ['beb84f6f-cb82-4221-9c99-a1d33253fc8a', 'f40fee67-fb1a-499a-bbff-fe170abd981b', 'a8c5a314-3566-47b8-8515-ed220c1c4236', '1abae45b-6c4b-4d93-9580-c39ec8266997'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:00 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Delete snapshot completed successfully. Jul 01 04:08:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-b1ed7411-2870-42a1-9e89-c66308607f33-delete_snapshot" released by "delete_snapshot" :: held 3.906s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Snapshots deleted, issuing volume delete {{(pid=86177) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 01 04:08:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-quobyte-1fcb114f-7181-4710-9e3b-8a3db648a988" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-1fcb114f-7181-4710-9e3b-8a3db648a988" acquired by "delete_volume" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:00 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce6f0ee-7706-4d61-8c54-9da9b07d5be8]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:00 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 Jul 01 04:08:00 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:01 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988" returned: 0 in 0.888s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:01 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988 Jul 01 04:08:01 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:02 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1fcb114f-7181-4710-9e3b-8a3db648a988" returned: 0 in 0.883s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-1fcb114f-7181-4710-9e3b-8a3db648a988" released by "delete_volume" :: held 1.867s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Flow 'volume_create_manager' (8a414e39-bc2f-41f4-8cf5-bcd50a899c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca497244-06fa-4aac-967b-e50826e5cfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca497244-06fa-4aac-967b-e50826e5cfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2081615381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e1a5f3-1d9c-480d-a599-773bcf08ff17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d62fe554e846669db1333affded787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:03Z,use_quota=True,user_id='e5bd0e4d87bf4664a548fdd6711a7f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca8a39c-4a38-4020-b12b-85cc28a857fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca8a39c-4a38-4020-b12b-85cc28a857fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92245536-b769-4fea-92ca-84cef72a11ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92245536-b769-4fea-92ca-84cef72a11ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e1a5f3-1d9c-480d-a599-773bcf08ff17', 'volume_name': 'volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c71958c-d15a-4f49-a806-92cede1a52ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c71958c-d15a-4f49-a806-92cede1a52ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed94bb2-42be-4d29-b9d6-9ed773a8f8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:02 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Volume 97e1a5f3-1d9c-480d-a599-773bcf08ff17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17', 'volume_size': 1} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2081615381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e1a5f3-1d9c-480d-a599-773bcf08ff17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d62fe554e846669db1333affded787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:03Z,use_quota=True,user_id='e5bd0e4d87bf4664a548fdd6711a7f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Creating volume 97e1a5f3-1d9c-480d-a599-773bcf08ff17 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:08:02 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Created reservations ['317c642b-81e9-4764-9910-58dc6312d7fb', '247374fa-e1bb-44d0-accb-1382a20b4455', 'acfc53f8-9ee7-4ce2-86b7-0d31b586db5a', '041bcde1-18d5-4d6f-8ad0-0241f0f80dda'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:02 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17 1073741824 Jul 01 04:08:02 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:02 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:08:02 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:04 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.122s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:08:04 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Deleted volume successfully. Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8baa5b12-dc9e-44ba-9985-c1b25dbe8794 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-1fcb114f-7181-4710-9e3b-8a3db648a988-delete_volume" released by "delete_volume" :: held 17.398s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:04 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17 1073741824" returned: 0 in 1.397s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:04 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17 Jul 01 04:08:04 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Flow 'volume_create_manager' (46b0159f-98c0-47a2-9106-c5eec81a5e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1220ae-a5bc-433c-aacd-d6e1d093863e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1220ae-a5bc-433c-aacd-d6e1d093863e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-16151747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d872184-fe57-4909-9dda-62f55478f1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03dbf2ca5994c6eaced9f48f255bbae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:05Z,use_quota=True,user_id='ae931f5684e14db4ba19979f3e4dfc37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8306e0b9-6efa-41b5-8e2f-40537dbdfd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8306e0b9-6efa-41b5-8e2f-40537dbdfd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9a3924-3579-41b2-adef-4e26fb62da7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9a3924-3579-41b2-adef-4e26fb62da7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d872184-fe57-4909-9dda-62f55478f1b2', 'volume_name': 'volume-6d872184-fe57-4909-9dda-62f55478f1b2', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01166444-5b1e-46f1-850a-4f8fd1aec5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01166444-5b1e-46f1-850a-4f8fd1aec5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7d9d89-27d2-4fcc-a1a4-fa34f1048da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:04 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Volume 6d872184-fe57-4909-9dda-62f55478f1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d872184-fe57-4909-9dda-62f55478f1b2', 'volume_size': 1} Jul 01 04:08:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:05 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17" returned: 0 in 0.992s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] <== create_volume: return (2457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.460s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.333s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-16151747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d872184-fe57-4909-9dda-62f55478f1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03dbf2ca5994c6eaced9f48f255bbae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:05Z,use_quota=True,user_id='ae931f5684e14db4ba19979f3e4dfc37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Creating volume 6d872184-fe57-4909-9dda-62f55478f1b2 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:08:05 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:05 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 1073741824 Jul 01 04:08:05 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed94bb2-42be-4d29-b9d6-9ed773a8f8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11152a4e-f456-4bad-8f9d-cdf36177cce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:05 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Volume volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17 (97e1a5f3-1d9c-480d-a599-773bcf08ff17): created successfully Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11152a4e-f456-4bad-8f9d-cdf36177cce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:05 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Flow 'volume_create_manager' (8a414e39-bc2f-41f4-8cf5-bcd50a899c2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:05 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-4a6cc40a-4e66-4356-b529-b4992c41a794 tempest-VolumesTransfersTest-1279133546 None] Created volume successfully. Jul 01 04:08:06 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 1073741824" returned: 0 in 1.006s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:06 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 Jul 01 04:08:06 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:06 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-3e089ce1-ab58-41c6-9ee3-327847c66196 tempest-VolumesTransfersTest-8026277 None] Transfer volume completed successfully. Jul 01 04:08:06 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2" returned: 0 in 0.671s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:08:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7d9d89-27d2-4fcc-a1a4-fa34f1048da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d872184-fe57-4909-9dda-62f55478f1b2', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146951b1-3248-4049-bc43-0adc19c080c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:07 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Volume volume-6d872184-fe57-4909-9dda-62f55478f1b2 (6d872184-fe57-4909-9dda-62f55478f1b2): created successfully Jul 01 04:08:07 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146951b1-3248-4049-bc43-0adc19c080c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:07 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Flow 'volume_create_manager' (46b0159f-98c0-47a2-9106-c5eec81a5e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:07 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d1391f1f-3a17-4ae1-93b0-cdfce2165661 tempest-VolumesDeleteCascade-683448675 None] Created volume successfully. Jul 01 04:08:07 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-75ac54d3-e58e-434d-a387-1213b5048855 req-9b334db1-d97a-4039-a0b5-a9f552774a4c tempest-TestMinimumBasicScenario-1764713216 None] Terminate volume connection completed successfully. Jul 01 04:08:07 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-75ac54d3-e58e-434d-a387-1213b5048855 req-9b334db1-d97a-4039-a0b5-a9f552774a4c tempest-TestMinimumBasicScenario-1764713216 None] Deleting attachment 81bafb81-aeb7-45d4-8bbd-fc2dce306ce9. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:08:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Acquiring lock "cinder-97e1a5f3-1d9c-480d-a599-773bcf08ff17-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Lock "cinder-97e1a5f3-1d9c-480d-a599-773bcf08ff17-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Acquiring lock "cinder-quobyte-97e1a5f3-1d9c-480d-a599-773bcf08ff17" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Lock "cinder-quobyte-97e1a5f3-1d9c-480d-a599-773bcf08ff17" acquired by "delete_volume" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:07 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96e7da3-046a-4567-aa17-03fe33da9d05]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:07 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17 Jul 01 04:08:07 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] Creating offline snapshot 69d63928-3106-4bab-91ee-ab174e9a8ebc of volume 6d872184-fe57-4909-9dda-62f55478f1b2 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:08:08 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67b03f8-1bf4-478d-817f-9cc2b41c7802]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:08 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 Jul 01 04:08:08 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:08 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17" returned: 0 in 0.812s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:08 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17 Jul 01 04:08:08 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:08 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2" returned: 0 in 0.836s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:08 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc 1G Jul 01 04:08:08 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:09 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-97e1a5f3-1d9c-480d-a599-773bcf08ff17" returned: 0 in 0.661s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Lock "cinder-quobyte-97e1a5f3-1d9c-480d-a599-773bcf08ff17" released by "delete_volume" :: held 1.536s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Created reservations ['6334d88d-1686-4744-9660-ee714cf9d6d0', '3df7df70-0ef1-4cef-a945-ddbe55195d3c', '63cb1cdd-3299-45d5-9f05-5ce8192c6316', '53436888-a329-46d8-b71f-88b000568c96'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:09 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:08:09 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Acquiring lock "cinder-9e1b865c-9310-409f-b457-8e96534e962c-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Lock "cinder-9e1b865c-9310-409f-b457-8e96534e962c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Acquiring lock "cinder-quobyte-9e1b865c-9310-409f-b457-8e96534e962c" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Lock "cinder-quobyte-9e1b865c-9310-409f-b457-8e96534e962c" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5b581f-0c7c-4132-976a-784306c99d56]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9e1b865c-9310-409f-b457-8e96534e962c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:09 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc 1G" returned: 0 in 1.006s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d872184-fe57-4909-9dda-62f55478f1b2 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:09 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d872184-fe57-4909-9dda-62f55478f1b2 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc Jul 01 04:08:09 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:09 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9e1b865c-9310-409f-b457-8e96534e962c Jul 01 04:08:09 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:10 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.717s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:08:10 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Deleted volume successfully. Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-822f4a2b-f9ae-4638-943c-674f56f3ca12 tempest-VolumesTransfersTest-1615773043 None] Lock "cinder-97e1a5f3-1d9c-480d-a599-773bcf08ff17-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Flow 'volume_create_manager' (3d1a92f4-a148-4a43-9f60-7eecd77951ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90416e57-ea0e-417b-9ff0-ebc909f8886d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90416e57-ea0e-417b-9ff0-ebc909f8886d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2088624780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f283ca-cbde-474c-b882-cda8f5cbbcee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d62fe554e846669db1333affded787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:10Z,use_quota=True,user_id='e5bd0e4d87bf4664a548fdd6711a7f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50021cba-2eae-4d68-a4ec-82a36b6041a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50021cba-2eae-4d68-a4ec-82a36b6041a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624f76d8-3b77-4e4c-91cb-bbc1148f80de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624f76d8-3b77-4e4c-91cb-bbc1148f80de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63f283ca-cbde-474c-b882-cda8f5cbbcee', 'volume_name': 'volume-63f283ca-cbde-474c-b882-cda8f5cbbcee', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc4734e-288f-4c99-abef-20c0b7d00fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc4734e-288f-4c99-abef-20c0b7d00fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280b3aa4-3a06-4fb3-b42c-a4467c6dd5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:10 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Volume 63f283ca-cbde-474c-b882-cda8f5cbbcee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63f283ca-cbde-474c-b882-cda8f5cbbcee', 'volume_size': 1} Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:10 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d872184-fe57-4909-9dda-62f55478f1b2 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc" returned: 0 in 0.738s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:10 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc is being set with open permissions: ugo+rw Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:10 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc Jul 01 04:08:10 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:10 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9e1b865c-9310-409f-b457-8e96534e962c" returned: 0 in 0.876s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9e1b865c-9310-409f-b457-8e96534e962c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:10 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9e1b865c-9310-409f-b457-8e96534e962c Jul 01 04:08:10 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:11 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:11 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc" returned: 0 in 0.686s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9e1b865c-9310-409f-b457-8e96534e962c" returned: 0 in 0.644s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Lock "cinder-quobyte-9e1b865c-9310-409f-b457-8e96534e962c" released by "delete_volume" :: held 1.581s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:11 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.info Jul 01 04:08:11 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:11 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Created reservations ['0e0dc97a-5d7e-4711-8c9a-f99d447cf8f0', '149f9fbf-8976-4397-a30f-2e013b73367d', '91261ec2-87d6-4cea-bc51-c56204fb1a2c', 'aa11e413-7e02-4257-a751-58f6166bd0c7'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:11 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:08:11 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:12 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.info" returned: 0 in 0.838s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:12 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.info is being set with open permissions: ugo+rw Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:12 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.info Jul 01 04:08:12 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:12 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.772s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:08:12 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Deleted volume successfully. Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6a2d871d-840a-4c24-8111-a4cc6775f5a6 tempest-TestMinimumBasicScenario-1764713216 None] Lock "cinder-9e1b865c-9310-409f-b457-8e96534e962c-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:12 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.info" returned: 0 in 0.720s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.947s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.410s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2088624780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f283ca-cbde-474c-b882-cda8f5cbbcee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d62fe554e846669db1333affded787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:10Z,use_quota=True,user_id='e5bd0e4d87bf4664a548fdd6711a7f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Creating volume 63f283ca-cbde-474c-b882-cda8f5cbbcee {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:08:12 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:08:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-63f283ca-cbde-474c-b882-cda8f5cbbcee 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:13 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-63f283ca-cbde-474c-b882-cda8f5cbbcee 1073741824 Jul 01 04:08:13 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:13 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-3b32b45f-6252-4d60-95e7-b9e4a15abe92 tempest-VolumesDeleteCascade-683448675 None] Create snapshot completed successfully Jul 01 04:08:14 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:08:14 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-63f283ca-cbde-474c-b882-cda8f5cbbcee 1073741824" returned: 0 in 1.293s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Flow 'volume_create_manager' (450c6dfb-659d-4a4a-b67b-dd8ea2fcdb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ec5d0c-1fae-45c8-92ee-7102414da5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ec5d0c-1fae-45c8-92ee-7102414da5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1785849139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2d1102-56fd-4640-8e12-7f76be8579e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03dbf2ca5994c6eaced9f48f255bbae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=69d63928-3106-4bab-91ee-ab174e9a8ebc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:14Z,use_quota=True,user_id='ae931f5684e14db4ba19979f3e4dfc37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a366189a-f0dc-467b-9851-1615fb074b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a366189a-f0dc-467b-9851-1615fb074b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02844e0f-830b-41c1-9491-545255744e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02844e0f-830b-41c1-9491-545255744e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1f2d1102-56fd-4640-8e12-7f76be8579e3', 'volume_name': 'volume-1f2d1102-56fd-4640-8e12-7f76be8579e3', 'volume_size': 1, 'snapshot_id': '69d63928-3106-4bab-91ee-ab174e9a8ebc'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fcea462-9d99-44c2-b6f3-7daf5e151311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fcea462-9d99-44c2-b6f3-7daf5e151311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bae496-5a12-4858-bb4b-3a8c99ba79aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:14 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Volume 1f2d1102-56fd-4640-8e12-7f76be8579e3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1f2d1102-56fd-4640-8e12-7f76be8579e3', 'volume_size': 1, 'snapshot_id': '69d63928-3106-4bab-91ee-ab174e9a8ebc'} Jul 01 04:08:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-63f283ca-cbde-474c-b882-cda8f5cbbcee {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:14 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-63f283ca-cbde-474c-b882-cda8f5cbbcee Jul 01 04:08:14 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:15 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-63f283ca-cbde-474c-b882-cda8f5cbbcee" returned: 0 in 0.806s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] <== create_volume: return (2203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.206s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.794s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-quobyte-69d63928-3106-4bab-91ee-ab174e9a8ebc-1f2d1102-56fd-4640-8e12-7f76be8579e3" by "_create_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280b3aa4-3a06-4fb3-b42c-a4467c6dd5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63f283ca-cbde-474c-b882-cda8f5cbbcee', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca455a2a-c0c1-4833-b573-91828cad1744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-69d63928-3106-4bab-91ee-ab174e9a8ebc-1f2d1102-56fd-4640-8e12-7f76be8579e3" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Creating volume 1f2d1102-56fd-4640-8e12-7f76be8579e3 from snapshot 69d63928-3106-4bab-91ee-ab174e9a8ebc {{(pid=86177) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-quobyte-1f2d1102-56fd-4640-8e12-7f76be8579e3" by "_copy_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:15 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Volume volume-63f283ca-cbde-474c-b882-cda8f5cbbcee (63f283ca-cbde-474c-b882-cda8f5cbbcee): created successfully Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca455a2a-c0c1-4833-b573-91828cad1744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Flow 'volume_create_manager' (3d1a92f4-a148-4a43-9f60-7eecd77951ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-1f2d1102-56fd-4640-8e12-7f76be8579e3" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] snapshot: 69d63928-3106-4bab-91ee-ab174e9a8ebc, volume: 1f2d1102-56fd-4640-8e12-7f76be8579e3, {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:15 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-804d8cf2-1654-498d-8d07-59c0aa8e966c tempest-VolumesTransfersTest-1279133546 None] Created volume successfully. Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96cd4ce-145c-4b53-8951-660a46e41057]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Flow 'volume_create_manager' (93915648-2a2d-46d2-af23-108994faa728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3695fecd-31eb-40b4-8501-ad6d445ccb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:15 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc Jul 01 04:08:15 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3695fecd-31eb-40b4-8501-ad6d445ccb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1936159236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79977376-41ff-4c3c-9171-11abd686a6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63fe91280dd4f1f9dca098494a074f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:15Z,use_quota=True,user_id='3714d7b4ace44918b49d8667427293f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5901f92a-f97c-486a-a986-d94a6b29dde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5901f92a-f97c-486a-a986-d94a6b29dde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f730ebe-229d-472c-ba0d-7ec1eb69c5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f730ebe-229d-472c-ba0d-7ec1eb69c5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79977376-41ff-4c3c-9171-11abd686a6ab', 'volume_name': 'volume-79977376-41ff-4c3c-9171-11abd686a6ab', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a310f8-96f1-4755-ad48-5019d7770b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a310f8-96f1-4755-ad48-5019d7770b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb05f885-d40a-40a4-a1c2-94ef68964efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:15 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Volume 79977376-41ff-4c3c-9171-11abd686a6ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79977376-41ff-4c3c-9171-11abd686a6ab', 'volume_size': 1} Jul 01 04:08:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:16 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc" returned: 0 in 0.814s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d872184-fe57-4909-9dda-62f55478f1b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:08:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 04:08:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Creating direct copy from snapshot {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 04:08:16 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80e8362-d70f-473a-ac14-264869aefeb0]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Acquiring lock "cinder-63f283ca-cbde-474c-b882-cda8f5cbbcee-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Lock "cinder-63f283ca-cbde-474c-b882-cda8f5cbbcee-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Acquiring lock "cinder-quobyte-63f283ca-cbde-474c-b882-cda8f5cbbcee" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Lock "cinder-quobyte-63f283ca-cbde-474c-b882-cda8f5cbbcee" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:16 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[db769a61-e4c4-4a37-b7cf-f21333a23d8c]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-63f283ca-cbde-474c-b882-cda8f5cbbcee {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:16 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 Jul 01 04:08:16 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:16 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-63f283ca-cbde-474c-b882-cda8f5cbbcee Jul 01 04:08:16 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:17 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2" returned: 0 in 0.862s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:17 devstack cinder-volume[86177]: DEBUG cinder.utils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Path /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1f2d1102-56fd-4640-8e12-7f76be8579e3 not found in is_blk_device check {{(pid=86177) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 04:08:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1f2d1102-56fd-4640-8e12-7f76be8579e3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:17 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1f2d1102-56fd-4640-8e12-7f76be8579e3 Jul 01 04:08:17 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:17 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-63f283ca-cbde-474c-b882-cda8f5cbbcee" returned: 0 in 0.793s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-63f283ca-cbde-474c-b882-cda8f5cbbcee {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:17 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-63f283ca-cbde-474c-b882-cda8f5cbbcee Jul 01 04:08:17 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:17 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-63f283ca-cbde-474c-b882-cda8f5cbbcee" returned: 0 in 0.813s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Lock "cinder-quobyte-63f283ca-cbde-474c-b882-cda8f5cbbcee" released by "delete_volume" :: held 1.677s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:18 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Created reservations ['84dd9798-6102-47f4-ad2d-23f69ec8fd2a', '66d8c175-3435-4055-8b88-ee3ead620277', '14dd9b03-0e47-464a-b5b1-61ed8426239d', 'bf92d0a3-79ad-44b0-8b9d-15b8fec4399a'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:18 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:08:18 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:20 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 2.068s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:20 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:08:20 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Deleted volume successfully. Jul 01 04:08:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-34989622-284c-4d7b-82d3-4df3049f5542 tempest-VolumesTransfersTest-1615773043 None] Lock "cinder-63f283ca-cbde-474c-b882-cda8f5cbbcee-delete_volume" released by "delete_volume" :: held 4.153s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:23 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1f2d1102-56fd-4640-8e12-7f76be8579e3" returned: 0 in 6.492s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:23 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7f2b40-082c-4aaa-90e9-80370524904f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:23 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 Jul 01 04:08:23 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:08:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:24 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:08:24 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:24 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2" returned: 0 in 1.111s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:24 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Image conversion details: src /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2, size 1024.00 MB, duration 6.49 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1f2d1102-56fd-4640-8e12-7f76be8579e3 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:08:24 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Converted 1024.00 MB image at 157.70 MB/s Jul 01 04:08:24 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1f2d1102-56fd-4640-8e12-7f76be8579e3 is being set with open permissions: ugo+rw Jul 01 04:08:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1f2d1102-56fd-4640-8e12-7f76be8579e3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:24 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1f2d1102-56fd-4640-8e12-7f76be8579e3 Jul 01 04:08:24 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:25 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.834s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1f2d1102-56fd-4640-8e12-7f76be8579e3" returned: 0 in 0.975s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:25 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-1f2d1102-56fd-4640-8e12-7f76be8579e3" released by "_copy_volume_from_snapshot" :: held 10.369s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-69d63928-3106-4bab-91ee-ab174e9a8ebc-1f2d1102-56fd-4640-8e12-7f76be8579e3" released by "_create_volume_from_snapshot" :: held 10.418s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.461s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.172s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1936159236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79977376-41ff-4c3c-9171-11abd686a6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63fe91280dd4f1f9dca098494a074f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:15Z,use_quota=True,user_id='3714d7b4ace44918b49d8667427293f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Creating volume 79977376-41ff-4c3c-9171-11abd686a6ab {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:08:25 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-79977376-41ff-4c3c-9171-11abd686a6ab 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:25 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-79977376-41ff-4c3c-9171-11abd686a6ab 1073741824 Jul 01 04:08:25 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bae496-5a12-4858-bb4b-3a8c99ba79aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f2d1102-56fd-4640-8e12-7f76be8579e3', 'volume_size': 1, 'snapshot_id': '69d63928-3106-4bab-91ee-ab174e9a8ebc'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa904a2-6f66-49c6-a12f-710136024002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:25 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Volume volume-1f2d1102-56fd-4640-8e12-7f76be8579e3 (1f2d1102-56fd-4640-8e12-7f76be8579e3): created successfully Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa904a2-6f66-49c6-a12f-710136024002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Flow 'volume_create_manager' (450c6dfb-659d-4a4a-b67b-dd8ea2fcdb0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:25 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-71f31419-6690-41d4-87c4-b98427f78888 tempest-VolumesDeleteCascade-683448675 None] Created volume successfully. Jul 01 04:08:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-6d872184-fe57-4909-9dda-62f55478f1b2-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-6d872184-fe57-4909-9dda-62f55478f1b2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Performing cascade delete. {{(pid=86177) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 01 04:08:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-69d63928-3106-4bab-91ee-ab174e9a8ebc-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-69d63928-3106-4bab-91ee-ab174e9a8ebc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-quobyte-6d872184-fe57-4909-9dda-62f55478f1b2" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-6d872184-fe57-4909-9dda-62f55478f1b2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-quobyte-69d63928-3106-4bab-91ee-ab174e9a8ebc" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-69d63928-3106-4bab-91ee-ab174e9a8ebc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Deleting offline snapshot 69d63928-3106-4bab-91ee-ab174e9a8ebc of volume 6d872184-fe57-4909-9dda-62f55478f1b2 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:08:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] snapshot_file for this snap is: volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:08:26 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28f84c0-eaca-48b6-a287-4b21e901b3cc]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:26 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-79977376-41ff-4c3c-9171-11abd686a6ab 1073741824" returned: 0 in 1.167s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:26 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc Jul 01 04:08:26 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-79977376-41ff-4c3c-9171-11abd686a6ab {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:26 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-79977376-41ff-4c3c-9171-11abd686a6ab Jul 01 04:08:26 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:27 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:27 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-79977376-41ff-4c3c-9171-11abd686a6ab" returned: 0 in 0.791s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc" returned: 0 in 0.954s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:08:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d872184-fe57-4909-9dda-62f55478f1b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:08:27 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7cca2c-ca71-40a1-a289-2aceb3be23de]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb05f885-d40a-40a4-a1c2-94ef68964efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79977376-41ff-4c3c-9171-11abd686a6ab', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2df274c-fa65-4adf-a242-619cb8c00416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:27 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Volume volume-79977376-41ff-4c3c-9171-11abd686a6ab (79977376-41ff-4c3c-9171-11abd686a6ab): created successfully Jul 01 04:08:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2df274c-fa65-4adf-a242-619cb8c00416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Flow 'volume_create_manager' (93915648-2a2d-46d2-af23-108994faa728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:27 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-78d56e0b-de2f-45c3-a3fe-ec00b8ff7a37 tempest-AttachVolumeNegativeTest-962019476 None] Created volume successfully. Jul 01 04:08:27 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 Jul 01 04:08:27 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:28 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:08:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Flow 'volume_create_manager' (2b74f4c1-82d7-42cc-8cfa-ecff0683d95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cfa0f0-889c-4465-82b0-5884724fc49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cfa0f0-889c-4465-82b0-5884724fc49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-955029420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59db7728-fef4-440d-ae10-1ced5e2ebc2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19441e81581246f9bd49e79e48217ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:29Z,use_quota=True,user_id='0951e02da37c4b70a43b8c6b1f8c839f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe89a40-888f-432b-a2ab-2919a6abe60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe89a40-888f-432b-a2ab-2919a6abe60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e1c212-01e1-4f75-8a79-ccb2d9b983d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:28 devstack cinder-volume[86177]: DEBUG cinder.image.glance [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Creating Keystone auth plugin from conf {{(pid=86177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 04:08:28 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2" returned: 0 in 0.951s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:28 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc Jul 01 04:08:28 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e1c212-01e1-4f75-8a79-ccb2d9b983d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '59db7728-fef4-440d-ae10-1ced5e2ebc2f', 'volume_name': 'volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f', 'volume_size': 1, 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43baa4017014b09a384294975690a79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'created_at': datetime.datetime(2026, 7, 1, 1, 52, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 1, 52, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f31ccb-e0cd-459c-a59a-d1dda4e4a9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f31ccb-e0cd-459c-a59a-d1dda4e4a9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0497ae6b-2d37-45f9-88d1-f6c56ba04a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:29 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Volume 59db7728-fef4-440d-ae10-1ced5e2ebc2f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f', 'volume_size': 1, 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43baa4017014b09a384294975690a79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'created_at': datetime.datetime(2026, 7, 1, 1, 52, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 1, 52, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 01 04:08:29 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Trying to clone 59db7728-fef4-440d-ae10-1ced5e2ebc2f from image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 at location (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]). {{(pid=86177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 04:08:29 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ppujistodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 04:08:29 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Image download 20.69 MB at 20.69 MB/s Jul 01 04:08:29 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:29 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[552ce98d-ed37-438a-906a-731fd1863e79]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ppujistodevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc" returned: 0 in 1.154s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:29 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc Jul 01 04:08:29 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:29 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ppujistodevstack@QuobyteHD Jul 01 04:08:29 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:30 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2.69d63928-3106-4bab-91ee-ab174e9a8ebc" returned: 0 in 0.765s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-69d63928-3106-4bab-91ee-ab174e9a8ebc" released by "_delete_snapshot" :: held 3.941s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-6d872184-fe57-4909-9dda-62f55478f1b2" released by "delete_snapshot" :: held 3.968s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:30 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ppujistodevstack@QuobyteHD" returned: 0 in 0.877s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:30 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Temporary image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 is fetched for user 0951e02da37c4b70a43b8c6b1f8c839f. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 04:08:30 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Created reservations ['65f2b24d-b427-43aa-8390-3802ece500ea', '885661e6-276f-44b1-b284-74726d064488', 'ce08d7aa-81f0-4a66-9312-5675a5ea4165', '77daa788-80d4-490e-8c0f-b053287bf6bc'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:30 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ebb819-adeb-4df3-8780-e8a3d45f18a0]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ppujistodevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:30 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Delete snapshot completed successfully. Jul 01 04:08:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-69d63928-3106-4bab-91ee-ab174e9a8ebc-delete_snapshot" released by "delete_snapshot" :: held 4.184s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Snapshots deleted, issuing volume delete {{(pid=86177) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 01 04:08:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-quobyte-6d872184-fe57-4909-9dda-62f55478f1b2" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-6d872184-fe57-4909-9dda-62f55478f1b2" acquired by "delete_volume" :: waited 0.022s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:30 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b48b20-e68a-4899-b214-a445717c1ee8]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:30 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ppujistodevstack@QuobyteHD Jul 01 04:08:30 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:31 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 Jul 01 04:08:31 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:31 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ppujistodevstack@QuobyteHD" returned: 0 in 0.892s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-955029420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59db7728-fef4-440d-ae10-1ced5e2ebc2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19441e81581246f9bd49e79e48217ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:29Z,use_quota=True,user_id='0951e02da37c4b70a43b8c6b1f8c839f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:08:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Creating volume 59db7728-fef4-440d-ae10-1ced5e2ebc2f {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:08:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:08:31 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:08:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:31 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f 1073741824 Jul 01 04:08:31 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:31 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2" returned: 0 in 0.987s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:31 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2 Jul 01 04:08:31 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-4f819017-2453-4402-befe-3eec695bea9a req-17323e53-dd32-4995-a86b-c315cd0f71a5 tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:32 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d872184-fe57-4909-9dda-62f55478f1b2" returned: 0 in 0.769s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:32 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f 1073741824" returned: 0 in 0.977s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-6d872184-fe57-4909-9dda-62f55478f1b2" released by "delete_volume" :: held 1.840s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:32 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Created reservations ['72285c2c-3aab-49be-a513-a1d3ca128466', '213ffe0d-579e-4a39-a9d6-bdd9b604581b', 'f873bab4-1852-433e-942c-0719f57f6fdf', 'e96fb30d-97d7-4a34-beb4-61c2b0c12ef7'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:32 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f Jul 01 04:08:32 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:32 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:08:32 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-1f2d1102-56fd-4640-8e12-7f76be8579e3-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-1f2d1102-56fd-4640-8e12-7f76be8579e3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "cinder-quobyte-1f2d1102-56fd-4640-8e12-7f76be8579e3" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-1f2d1102-56fd-4640-8e12-7f76be8579e3" acquired by "delete_volume" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58f7d00-602f-43ab-8fca-8532f32f5be1]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1f2d1102-56fd-4640-8e12-7f76be8579e3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:33 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f" returned: 0 in 0.750s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-4f819017-2453-4402-befe-3eec695bea9a req-17323e53-dd32-4995-a86b-c315cd0f71a5 tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.435s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[0088c36e-6134-47cb-a9e6-e0d1fadafecf]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-4f819017-2453-4402-befe-3eec695bea9a req-17323e53-dd32-4995-a86b-c315cd0f71a5 tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-79977376-41ff-4c3c-9171-11abd686a6ab {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Attempting download of 44c37c3e-a2cd-450f-a8e6-b9270ee06395 ((None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}])) to volume 59db7728-fef4-440d-ae10-1ced5e2ebc2f. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 04:08:33 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1f2d1102-56fd-4640-8e12-7f76be8579e3 Jul 01 04:08:33 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b308e38e-6203-4f49-aab3-ae49db7efcc7]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gmpv16ej {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:33 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.795s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:08:33 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Deleted volume successfully. Jul 01 04:08:33 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcb6bf4-fd5d-4444-9adf-d67946b44bc7 tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-6d872184-fe57-4909-9dda-62f55478f1b2-delete_volume" released by "delete_volume" :: held 7.139s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:33 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-79977376-41ff-4c3c-9171-11abd686a6ab Jul 01 04:08:33 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:33 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gmpv16ej Jul 01 04:08:33 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:34 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1f2d1102-56fd-4640-8e12-7f76be8579e3" returned: 0 in 0.967s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1f2d1102-56fd-4640-8e12-7f76be8579e3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:34 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1f2d1102-56fd-4640-8e12-7f76be8579e3 Jul 01 04:08:34 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:34 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-4f819017-2453-4402-befe-3eec695bea9a req-17323e53-dd32-4995-a86b-c315cd0f71a5 tempest-AttachVolumeNegativeTest-962019476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-79977376-41ff-4c3c-9171-11abd686a6ab" returned: 0 in 0.954s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-4f819017-2453-4402-befe-3eec695bea9a req-17323e53-dd32-4995-a86b-c315cd0f71a5 tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.983s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:34 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gmpv16ej" returned: 0 in 0.867s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gmpv16ej {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-4f819017-2453-4402-befe-3eec695bea9a req-17323e53-dd32-4995-a86b-c315cd0f71a5 tempest-AttachVolumeNegativeTest-962019476 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-79977376-41ff-4c3c-9171-11abd686a6ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91b9beb8-3c86-4b87-8a45-bbe8e015039e', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:08:34 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-4f819017-2453-4402-befe-3eec695bea9a req-17323e53-dd32-4995-a86b-c315cd0f71a5 tempest-AttachVolumeNegativeTest-962019476 None] attachment_update completed successfully. Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Flow 'volume_create_manager' (e9fd614c-1d88-40c8-9f56-b65953660efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:34 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gmpv16ej Jul 01 04:08:34 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a32bad5-6d94-4587-aa52-8e99c836a259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a32bad5-6d94-4587-aa52-8e99c836a259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-295921977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0cc050d-5edf-4a14-ba08-a21dce8e05c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f9665dae748df94fe6c0a37b49d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:35Z,use_quota=True,user_id='c11672eeb61849b3acb0d2b8ff54aea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624efee4-ea92-4fbd-af73-d54ddbd68145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624efee4-ea92-4fbd-af73-d54ddbd68145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3128cd3-f1a8-41d4-92f3-580e265c2943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3128cd3-f1a8-41d4-92f3-580e265c2943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0cc050d-5edf-4a14-ba08-a21dce8e05c4', 'volume_name': 'volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322cc189-2fd7-4e12-884c-be2c73f3eb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322cc189-2fd7-4e12-884c-be2c73f3eb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0ad473-8eef-4b08-8686-43475aa763a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:34 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume e0cc050d-5edf-4a14-ba08-a21dce8e05c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4', 'volume_size': 1} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-295921977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0cc050d-5edf-4a14-ba08-a21dce8e05c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f9665dae748df94fe6c0a37b49d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:35Z,use_quota=True,user_id='c11672eeb61849b3acb0d2b8ff54aea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Creating volume e0cc050d-5edf-4a14-ba08-a21dce8e05c4 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:08:34 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:08:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:34 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4 1073741824 Jul 01 04:08:34 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:35 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1f2d1102-56fd-4640-8e12-7f76be8579e3" returned: 0 in 0.878s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-quobyte-1f2d1102-56fd-4640-8e12-7f76be8579e3" released by "delete_volume" :: held 1.896s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:35 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Created reservations ['201fac2e-eb50-44a4-baf9-53ccae266130', '22a48185-750f-4bb2-91e0-5c94184791d8', 'd949b3d2-01e5-48c0-bd95-6942f2f8afce', '8843f400-07fb-49b1-b571-f768c8aedd2d'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:35 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gmpv16ej" returned: 1 in 0.922s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_gmpv16ej' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:08:35 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5a82c8-835f-45c0-bb52-57366cab9aa9]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ppujistodevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:35 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:35 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:35 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:08:35 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:35 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ppujistodevstack@QuobyteHD Jul 01 04:08:35 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:35 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4 1073741824" returned: 0 in 1.009s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:35 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4 Jul 01 04:08:35 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:36 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.886s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:36 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:08:36 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Deleted volume successfully. Jul 01 04:08:36 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1c11d090-2fda-4053-ad57-3375e4c2b78b tempest-VolumesDeleteCascade-683448675 None] Lock "cinder-1f2d1102-56fd-4640-8e12-7f76be8579e3-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:36 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ppujistodevstack@QuobyteHD" returned: 0 in 1.051s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:36 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] 44c37c3e-a2cd-450f-a8e6-b9270ee06395 was qcow2, converting to raw {{(pid=86177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 04:08:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ppujistodevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:36 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ppujistodevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f Jul 01 04:08:36 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:36 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4" returned: 0 in 0.839s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:08:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0ad473-8eef-4b08-8686-43475aa763a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f75f3c0-3683-4ada-adae-6d1383638db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:36 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4 (e0cc050d-5edf-4a14-ba08-a21dce8e05c4): created successfully Jul 01 04:08:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f75f3c0-3683-4ada-adae-6d1383638db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Flow 'volume_create_manager' (e9fd614c-1d88-40c8-9f56-b65953660efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:36 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-37abd3ae-170e-4adb-a65a-afff4d98c5c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Created volume successfully. Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=110,cinder:SELECT=76,cinder:INSERT=23,cinder:DELETE=7 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Flow 'volume_create_manager' (9a3aaa09-5474-43cb-8c97-4f8841342b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc95c2b2-ac07-403a-b8d6-31c51e292622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc95c2b2-ac07-403a-b8d6-31c51e292622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-247917317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803b849e-7ce1-4114-ae97-4aba89a0ab7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f9665dae748df94fe6c0a37b49d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:38Z,use_quota=True,user_id='c11672eeb61849b3acb0d2b8ff54aea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adb2c3f-5cca-45b5-8464-806ae35c454e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adb2c3f-5cca-45b5-8464-806ae35c454e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd393dfe-d631-49de-ab2c-a36d7511ea2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd393dfe-d631-49de-ab2c-a36d7511ea2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '803b849e-7ce1-4114-ae97-4aba89a0ab7a', 'volume_name': 'volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6526be-0bdc-4d15-b827-634b663b1a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6526be-0bdc-4d15-b827-634b663b1a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557568f3-a89b-4ccb-af34-c18fb35259a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:38 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume 803b849e-7ce1-4114-ae97-4aba89a0ab7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a', 'volume_size': 1} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-247917317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803b849e-7ce1-4114-ae97-4aba89a0ab7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f9665dae748df94fe6c0a37b49d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:38Z,use_quota=True,user_id='c11672eeb61849b3acb0d2b8ff54aea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Creating volume 803b849e-7ce1-4114-ae97-4aba89a0ab7a {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:08:38 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:38 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a 1073741824 Jul 01 04:08:38 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:38 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ppujistodevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f" returned: 0 in 2.401s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ppujistodevstack@QuobyteHD, size 112.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:08:38 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Converted 112.00 MB image at 46.59 MB/s Jul 01 04:08:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:38 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f 1G Jul 01 04:08:38 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Flow 'volume_create_manager' (c7495c84-ed5b-4415-9c86-10dd116d2e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f696b33-73ab-4719-a1f6-6a20b5385743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=88,cinder:SELECT=87,cinder:INSERT=26,cinder:DELETE=9 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f696b33-73ab-4719-a1f6-6a20b5385743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1224444552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f9665dae748df94fe6c0a37b49d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:39Z,use_quota=True,user_id='c11672eeb61849b3acb0d2b8ff54aea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0075cef3-a655-4bae-b35f-bb4e1638fa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0075cef3-a655-4bae-b35f-bb4e1638fa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cb6670-3d4b-41ae-a5ac-e82b64363a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cb6670-3d4b-41ae-a5ac-e82b64363a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1', 'volume_name': 'volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93e0da0-66f2-4115-8226-ca40c5573eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93e0da0-66f2-4115-8226-ca40c5573eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28cb2a24-e6a0-47da-ab88-86ff9dedbbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:39 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume 5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1', 'volume_size': 1} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Flow 'volume_create_manager' (547ac856-8179-4e96-82ff-483e0ef16d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d220e5-5d90-4789-b05f-c988abdbdc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:39 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a 1073741824" returned: 0 in 1.385s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d220e5-5d90-4789-b05f-c988abdbdc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-285996184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d664640-9bea-4237-a2ca-104e4089fd89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f9665dae748df94fe6c0a37b49d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:40Z,use_quota=True,user_id='c11672eeb61849b3acb0d2b8ff54aea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b6cdaa-1f60-4b88-ac30-ee5fdb7e98c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b6cdaa-1f60-4b88-ac30-ee5fdb7e98c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b973549-bff4-46ac-9644-b178b8f5c0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b973549-bff4-46ac-9644-b178b8f5c0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d664640-9bea-4237-a2ca-104e4089fd89', 'volume_name': 'volume-9d664640-9bea-4237-a2ca-104e4089fd89', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa79bdda-2703-4e05-a07f-b379a5695468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:40 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa79bdda-2703-4e05-a07f-b379a5695468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c576dd-4352-48e3-be13-d92419289f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:40 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume 9d664640-9bea-4237-a2ca-104e4089fd89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d664640-9bea-4237-a2ca-104e4089fd89', 'volume_size': 1} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f 1G" returned: 0 in 1.168s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e423b423-1214-494c-8aea-16d57ec5d7da]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:40 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a Jul 01 04:08:40 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:40 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f Jul 01 04:08:40 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Flow 'volume_create_manager' (b14e2013-58a6-4cc5-bbf6-ce70348fdf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d744e998-9e1a-47ab-afff-262e27b3b79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d744e998-9e1a-47ab-afff-262e27b3b79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1540678963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7284bae8-411a-452f-b911-8d368272ebcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f9665dae748df94fe6c0a37b49d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:40Z,use_quota=True,user_id='c11672eeb61849b3acb0d2b8ff54aea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0030ed-9c04-4d58-9230-63100ceb4125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0030ed-9c04-4d58-9230-63100ceb4125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed483a68-211d-4ade-95e2-f55cea996e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed483a68-211d-4ade-95e2-f55cea996e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7284bae8-411a-452f-b911-8d368272ebcd', 'volume_name': 'volume-7284bae8-411a-452f-b911-8d368272ebcd', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e50a0b9-c279-48e6-885a-315bb6367716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e50a0b9-c279-48e6-885a-315bb6367716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1f5d0c-5eb6-454a-a3bb-cc2706ba6da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:40 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume 7284bae8-411a-452f-b911-8d368272ebcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7284bae8-411a-452f-b911-8d368272ebcd', 'volume_size': 1} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Flow 'volume_create_manager' (20eda0c8-1519-4133-a211-e5a47732c8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4230b0-5cba-46f9-bcdb-6c8258f8f85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4230b0-5cba-46f9-bcdb-6c8258f8f85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1955213672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf50516-0271-43ac-81db-4bbe19809473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f9665dae748df94fe6c0a37b49d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:41Z,use_quota=True,user_id='c11672eeb61849b3acb0d2b8ff54aea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb954d0-e127-4570-a13f-b6aa64b53de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb954d0-e127-4570-a13f-b6aa64b53de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be56a442-78bf-44f1-a843-7a270233ea8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be56a442-78bf-44f1-a843-7a270233ea8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caf50516-0271-43ac-81db-4bbe19809473', 'volume_name': 'volume-caf50516-0271-43ac-81db-4bbe19809473', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc19bc5-82fb-452b-a7e8-59c3935754bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc19bc5-82fb-452b-a7e8-59c3935754bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:41 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a165ce4a-4337-46b5-b8d9-6f3b07854561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:41 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume caf50516-0271-43ac-81db-4bbe19809473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caf50516-0271-43ac-81db-4bbe19809473', 'volume_size': 1} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a" returned: 0 in 0.975s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] <== create_volume: return (2489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.491s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.833s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1224444552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f9665dae748df94fe6c0a37b49d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:39Z,use_quota=True,user_id='c11672eeb61849b3acb0d2b8ff54aea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Creating volume 5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:08:41 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557568f3-a89b-4ccb-af34-c18fb35259a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a5c4fb-6b71-4194-9fea-9f92e6859c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:41 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1 1073741824 Jul 01 04:08:41 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:41 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a (803b849e-7ce1-4114-ae97-4aba89a0ab7a): created successfully Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a5c4fb-6b71-4194-9fea-9f92e6859c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Flow 'volume_create_manager' (9a3aaa09-5474-43cb-8c97-4f8841342b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:41 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-edfc9afd-36f1-4dda-a003-f29ae15daaf7 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Created volume successfully. Jul 01 04:08:41 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f" returned: 0 in 1.226s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:41 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-8303b537-bb76-4b1f-bb11-61bcca72d7b5 req-37700f13-35d8-4d86-8b8d-f0eebdad1d21 tempest-AttachVolumeNegativeTest-962019476 None] Terminate volume connection completed successfully. Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-8303b537-bb76-4b1f-bb11-61bcca72d7b5 req-37700f13-35d8-4d86-8b8d-f0eebdad1d21 tempest-AttachVolumeNegativeTest-962019476 None] Deleting attachment 91b9beb8-3c86-4b87-8a45-bbe8e015039e. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:08:41 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f Jul 01 04:08:41 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Flow 'volume_create_manager' (354672d2-8cae-4ac6-a1a4-76f9277c835c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b58372a-2019-411b-a726-6d96bcff2eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b58372a-2019-411b-a726-6d96bcff2eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1360406878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98d65e9-3b58-496d-933f-38d945dd3da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec56df8e229f46f3ac8c3688e1235c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:42Z,use_quota=True,user_id='2fd7358d2c8c4616bc05ec56f335a36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eccef944-83c4-4bc6-af20-e13955445307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eccef944-83c4-4bc6-af20-e13955445307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a7df6a-b604-4d36-9c8b-19eb22c50a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a7df6a-b604-4d36-9c8b-19eb22c50a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a98d65e9-3b58-496d-933f-38d945dd3da6', 'volume_name': 'volume-a98d65e9-3b58-496d-933f-38d945dd3da6', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63eaaa1-1552-43c5-995a-0dafccc3d4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63eaaa1-1552-43c5-995a-0dafccc3d4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e17708-a47b-45cb-b921-3d7c16802097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:41 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Volume a98d65e9-3b58-496d-933f-38d945dd3da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a98d65e9-3b58-496d-933f-38d945dd3da6', 'volume_size': 1} Jul 01 04:08:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:42 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1 1073741824" returned: 0 in 1.116s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:42 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f" returned: 1 in 0.901s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Downloaded image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 ((None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}])) to volume 59db7728-fef4-440d-ae10-1ced5e2ebc2f successfully. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Temporary image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 for user 0951e02da37c4b70a43b8c6b1f8c839f is deleted. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Marking volume 59db7728-fef4-440d-ae10-1ced5e2ebc2f as bootable. {{(pid=86177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 04:08:42 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1 Jul 01 04:08:42 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Copying metadata from image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 to 59db7728-fef4-440d-ae10-1ced5e2ebc2f. {{(pid=86177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Creating volume glance metadata for volume 59db7728-fef4-440d-ae10-1ced5e2ebc2f backed by image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0497ae6b-2d37-45f9-88d1-f6c56ba04a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f', 'volume_size': 1, 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43baa4017014b09a384294975690a79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'created_at': datetime.datetime(2026, 7, 1, 1, 52, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 1, 52, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de0b98a-5dc0-4af0-b4f5-0fe265ca707c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:42 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Volume volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f (59db7728-fef4-440d-ae10-1ced5e2ebc2f): created successfully Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de0b98a-5dc0-4af0-b4f5-0fe265ca707c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Flow 'volume_create_manager' (2b74f4c1-82d7-42cc-8cfa-ecff0683d95e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:42 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-ec4ee380-9197-49e0-942b-ea17d5c1b23c tempest-VolumesExtendTest-1096873957 None] Created volume successfully. Jul 01 04:08:42 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1" returned: 0 in 0.681s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.877s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-285996184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d664640-9bea-4237-a2ca-104e4089fd89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f9665dae748df94fe6c0a37b49d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:40Z,use_quota=True,user_id='c11672eeb61849b3acb0d2b8ff54aea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Creating volume 9d664640-9bea-4237-a2ca-104e4089fd89 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:08:42 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9d664640-9bea-4237-a2ca-104e4089fd89 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28cb2a24-e6a0-47da-ab88-86ff9dedbbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:42 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9d664640-9bea-4237-a2ca-104e4089fd89 1073741824 Jul 01 04:08:42 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4c51d7-0532-4614-809b-e4753f1f3198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:42 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1 (5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1): created successfully Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4c51d7-0532-4614-809b-e4753f1f3198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Flow 'volume_create_manager' (c7495c84-ed5b-4415-9c86-10dd116d2e20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:43 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-a818e97e-4381-4416-aafd-d903a999d8c2 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Created volume successfully. Jul 01 04:08:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b60a6a6d-99ae-423d-87fb-cad02c62587a tempest-VolumesExtendTest-1096873957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:43 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9d664640-9bea-4237-a2ca-104e4089fd89 1073741824" returned: 0 in 0.916s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9d664640-9bea-4237-a2ca-104e4089fd89 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:43 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9d664640-9bea-4237-a2ca-104e4089fd89 Jul 01 04:08:43 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:44 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9d664640-9bea-4237-a2ca-104e4089fd89" returned: 0 in 0.654s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1540678963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7284bae8-411a-452f-b911-8d368272ebcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f9665dae748df94fe6c0a37b49d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:40Z,use_quota=True,user_id='c11672eeb61849b3acb0d2b8ff54aea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Creating volume 7284bae8-411a-452f-b911-8d368272ebcd {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:08:44 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7284bae8-411a-452f-b911-8d368272ebcd 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:44 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7284bae8-411a-452f-b911-8d368272ebcd 1073741824 Jul 01 04:08:44 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c576dd-4352-48e3-be13-d92419289f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d664640-9bea-4237-a2ca-104e4089fd89', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c835da-c1f7-4b25-8e3a-7a33da315982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:44 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume volume-9d664640-9bea-4237-a2ca-104e4089fd89 (9d664640-9bea-4237-a2ca-104e4089fd89): created successfully Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c835da-c1f7-4b25-8e3a-7a33da315982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Flow 'volume_create_manager' (547ac856-8179-4e96-82ff-483e0ef16d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:44 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-4dbac9a3-527d-4822-bb18-0e7c302c1a1b tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Created volume successfully. Jul 01 04:08:45 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7284bae8-411a-452f-b911-8d368272ebcd 1073741824" returned: 0 in 1.075s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7284bae8-411a-452f-b911-8d368272ebcd {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:45 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7284bae8-411a-452f-b911-8d368272ebcd Jul 01 04:08:45 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:46 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7284bae8-411a-452f-b911-8d368272ebcd" returned: 0 in 0.676s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.281s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1955213672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf50516-0271-43ac-81db-4bbe19809473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964f9665dae748df94fe6c0a37b49d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:41Z,use_quota=True,user_id='c11672eeb61849b3acb0d2b8ff54aea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Creating volume caf50516-0271-43ac-81db-4bbe19809473 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:08:46 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-caf50516-0271-43ac-81db-4bbe19809473 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1f5d0c-5eb6-454a-a3bb-cc2706ba6da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7284bae8-411a-452f-b911-8d368272ebcd', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec54ad0-d58a-4418-a1e9-2509a812d795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:46 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-caf50516-0271-43ac-81db-4bbe19809473 1073741824 Jul 01 04:08:46 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:46 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume volume-7284bae8-411a-452f-b911-8d368272ebcd (7284bae8-411a-452f-b911-8d368272ebcd): created successfully Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec54ad0-d58a-4418-a1e9-2509a812d795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Flow 'volume_create_manager' (b14e2013-58a6-4cc5-bbf6-ce70348fdf62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:46 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-271259e8-59e5-4e7b-9a9d-81e7f343a0db tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Created volume successfully. Jul 01 04:08:47 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-caf50516-0271-43ac-81db-4bbe19809473 1073741824" returned: 0 in 0.920s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-caf50516-0271-43ac-81db-4bbe19809473 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:47 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-caf50516-0271-43ac-81db-4bbe19809473 Jul 01 04:08:47 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:47 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-caf50516-0271-43ac-81db-4bbe19809473" returned: 0 in 0.663s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:08:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.055s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1360406878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98d65e9-3b58-496d-933f-38d945dd3da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec56df8e229f46f3ac8c3688e1235c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:42Z,use_quota=True,user_id='2fd7358d2c8c4616bc05ec56f335a36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:08:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Creating volume a98d65e9-3b58-496d-933f-38d945dd3da6 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:08:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:08:47 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:08:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a98d65e9-3b58-496d-933f-38d945dd3da6 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:48 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a98d65e9-3b58-496d-933f-38d945dd3da6 1073741824 Jul 01 04:08:48 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a165ce4a-4337-46b5-b8d9-6f3b07854561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf50516-0271-43ac-81db-4bbe19809473', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:48 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:48 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2cf546-7220-4331-a3ca-3add11c8ebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:48 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Volume volume-caf50516-0271-43ac-81db-4bbe19809473 (caf50516-0271-43ac-81db-4bbe19809473): created successfully Jul 01 04:08:48 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2cf546-7220-4331-a3ca-3add11c8ebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:48 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Flow 'volume_create_manager' (20eda0c8-1519-4133-a211-e5a47732c8fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:48 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-68970f56-73f6-4e23-8460-5b8d9fa56241 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Created volume successfully. Jul 01 04:08:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "cinder-caf50516-0271-43ac-81db-4bbe19809473-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-caf50516-0271-43ac-81db-4bbe19809473-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "cinder-quobyte-caf50516-0271-43ac-81db-4bbe19809473" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-quobyte-caf50516-0271-43ac-81db-4bbe19809473" acquired by "delete_volume" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:48 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdbe54c-e1cd-40a6-9ab5-07e108670add]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-caf50516-0271-43ac-81db-4bbe19809473 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:48 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-caf50516-0271-43ac-81db-4bbe19809473 Jul 01 04:08:48 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:48 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a98d65e9-3b58-496d-933f-38d945dd3da6 1073741824" returned: 0 in 0.882s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a98d65e9-3b58-496d-933f-38d945dd3da6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:48 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a98d65e9-3b58-496d-933f-38d945dd3da6 Jul 01 04:08:48 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:49 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-caf50516-0271-43ac-81db-4bbe19809473" returned: 0 in 0.806s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-caf50516-0271-43ac-81db-4bbe19809473 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:49 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-caf50516-0271-43ac-81db-4bbe19809473 Jul 01 04:08:49 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:49 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a98d65e9-3b58-496d-933f-38d945dd3da6" returned: 0 in 0.660s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:08:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b60a6a6d-99ae-423d-87fb-cad02c62587a tempest-VolumesExtendTest-1096873957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 6.025s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e17708-a47b-45cb-b921-3d7c16802097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a98d65e9-3b58-496d-933f-38d945dd3da6', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97756d6-87b9-4932-bf3d-32f67de501a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:49 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17cfc6c-270c-4b8c-830e-32000fc618ba]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b60a6a6d-99ae-423d-87fb-cad02c62587a tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:49 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Volume volume-a98d65e9-3b58-496d-933f-38d945dd3da6 (a98d65e9-3b58-496d-933f-38d945dd3da6): created successfully Jul 01 04:08:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97756d6-87b9-4932-bf3d-32f67de501a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Flow 'volume_create_manager' (354672d2-8cae-4ac6-a1a4-76f9277c835c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:49 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-5f44a280-7ea7-4cfa-9c08-019da1e16fd9 tempest-VolumesTransfersV355Test-272942894 None] Created volume successfully. Jul 01 04:08:49 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f Jul 01 04:08:49 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:50 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-caf50516-0271-43ac-81db-4bbe19809473" returned: 0 in 0.694s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-quobyte-caf50516-0271-43ac-81db-4bbe19809473" released by "delete_volume" :: held 1.552s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:50 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Created reservations ['bdcdaa0c-5cce-4491-a85c-4dd035ace596', '51b862a6-607f-40ee-8d6c-65a909fba9a9', '273274e0-6204-4ce8-860d-7d2f1aa3531d', '37af4250-d86f-4421-86e6-955b3978c903'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:50 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:08:50 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:50 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b60a6a6d-99ae-423d-87fb-cad02c62587a tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f" returned: 0 in 0.859s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b60a6a6d-99ae-423d-87fb-cad02c62587a tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:50 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f Jul 01 04:08:50 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "cinder-7284bae8-411a-452f-b911-8d368272ebcd-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-7284bae8-411a-452f-b911-8d368272ebcd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "cinder-quobyte-7284bae8-411a-452f-b911-8d368272ebcd" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-quobyte-7284bae8-411a-452f-b911-8d368272ebcd" acquired by "delete_volume" :: waited 0.022s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:51 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5d7fb1-0bbd-4f0d-9acd-0dd87ff0fa24]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7284bae8-411a-452f-b911-8d368272ebcd {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:51 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-da2d579e-dcd5-47dc-a483-acfbd10d7446 tempest-VolumesTransfersV355Test-1020588595 None] Transfer volume completed successfully. Jul 01 04:08:51 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.799s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:51 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:08:51 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Deleted volume successfully. Jul 01 04:08:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0209c2bf-89d3-4b2c-86a1-a9cbbc1bb0e5 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-caf50516-0271-43ac-81db-4bbe19809473-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:51 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7284bae8-411a-452f-b911-8d368272ebcd Jul 01 04:08:51 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:51 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b60a6a6d-99ae-423d-87fb-cad02c62587a tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f" returned: 1 in 0.970s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b60a6a6d-99ae-423d-87fb-cad02c62587a tempest-VolumesExtendTest-1096873957 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:08:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b60a6a6d-99ae-423d-87fb-cad02c62587a tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f 2G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b60a6a6d-99ae-423d-87fb-cad02c62587a tempest-VolumesExtendTest-1096873957 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f 2G" returned: 0 in 0.069s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b60a6a6d-99ae-423d-87fb-cad02c62587a tempest-VolumesExtendTest-1096873957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.955s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:51 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-b60a6a6d-99ae-423d-87fb-cad02c62587a tempest-VolumesExtendTest-1096873957 None] Extend volume completed successfully. Jul 01 04:08:52 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7284bae8-411a-452f-b911-8d368272ebcd" returned: 0 in 0.950s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7284bae8-411a-452f-b911-8d368272ebcd {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Acquiring lock "cinder-a98d65e9-3b58-496d-933f-38d945dd3da6-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:52 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7284bae8-411a-452f-b911-8d368272ebcd Jul 01 04:08:52 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Lock "cinder-a98d65e9-3b58-496d-933f-38d945dd3da6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Acquiring lock "cinder-quobyte-a98d65e9-3b58-496d-933f-38d945dd3da6" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Lock "cinder-quobyte-a98d65e9-3b58-496d-933f-38d945dd3da6" acquired by "delete_volume" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3953c77-0370-40d4-87d1-cd10be7d7b21]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a98d65e9-3b58-496d-933f-38d945dd3da6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "cinder-79977376-41ff-4c3c-9171-11abd686a6ab-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Lock "cinder-79977376-41ff-4c3c-9171-11abd686a6ab-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "cinder-quobyte-79977376-41ff-4c3c-9171-11abd686a6ab" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Lock "cinder-quobyte-79977376-41ff-4c3c-9171-11abd686a6ab" acquired by "delete_volume" :: waited 0.027s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:52 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a98d65e9-3b58-496d-933f-38d945dd3da6 Jul 01 04:08:52 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff25faf-2d8c-46bd-9d40-7816ce90acc4]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-79977376-41ff-4c3c-9171-11abd686a6ab {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Acquiring lock "cinder-59db7728-fef4-440d-ae10-1ced5e2ebc2f-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Lock "cinder-59db7728-fef4-440d-ae10-1ced5e2ebc2f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Acquiring lock "cinder-quobyte-59db7728-fef4-440d-ae10-1ced5e2ebc2f" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Lock "cinder-quobyte-59db7728-fef4-440d-ae10-1ced5e2ebc2f" acquired by "delete_volume" :: waited 0.027s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:52 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-79977376-41ff-4c3c-9171-11abd686a6ab Jul 01 04:08:52 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[839320d5-6cfe-4794-8afa-5700ef01c699]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:52 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f Jul 01 04:08:52 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:52 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7284bae8-411a-452f-b911-8d368272ebcd" returned: 0 in 0.844s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-quobyte-7284bae8-411a-452f-b911-8d368272ebcd" released by "delete_volume" :: held 1.895s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:52 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Created reservations ['dd063a37-ea5a-4e79-99c9-4e6efcb0857d', 'fb20eded-e96b-4c56-8ce3-b98bc3cbcb82', 'ca4fc12f-255e-4062-8e84-4d7cddc61087', 'fb7798e8-9403-4157-a4e4-418c21f4fe07'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:53 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:08:53 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "cinder-9d664640-9bea-4237-a2ca-104e4089fd89-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-9d664640-9bea-4237-a2ca-104e4089fd89-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:53 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a98d65e9-3b58-496d-933f-38d945dd3da6" returned: 0 in 1.079s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a98d65e9-3b58-496d-933f-38d945dd3da6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:53 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-79977376-41ff-4c3c-9171-11abd686a6ab" returned: 0 in 0.943s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-79977376-41ff-4c3c-9171-11abd686a6ab {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:53 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a98d65e9-3b58-496d-933f-38d945dd3da6 Jul 01 04:08:53 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "cinder-quobyte-9d664640-9bea-4237-a2ca-104e4089fd89" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:53 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-79977376-41ff-4c3c-9171-11abd686a6ab Jul 01 04:08:53 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-quobyte-9d664640-9bea-4237-a2ca-104e4089fd89" acquired by "delete_volume" :: waited 0.035s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[de54a4c1-4011-47cb-90c2-ff99f97b6d49]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9d664640-9bea-4237-a2ca-104e4089fd89 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:53 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f" returned: 0 in 1.058s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:53 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9d664640-9bea-4237-a2ca-104e4089fd89 Jul 01 04:08:53 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:53 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f Jul 01 04:08:53 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:53 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.936s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:53 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:08:53 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Deleted volume successfully. Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b2fb2ace-ad45-46d2-bacb-aee25bb27864 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-7284bae8-411a-452f-b911-8d368272ebcd-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:54 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a98d65e9-3b58-496d-933f-38d945dd3da6" returned: 0 in 0.885s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Lock "cinder-quobyte-a98d65e9-3b58-496d-933f-38d945dd3da6" released by "delete_volume" :: held 2.024s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:54 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-79977376-41ff-4c3c-9171-11abd686a6ab" returned: 0 in 0.879s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Lock "cinder-quobyte-79977376-41ff-4c3c-9171-11abd686a6ab" released by "delete_volume" :: held 1.876s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Created reservations ['161fdec1-2cbb-48fa-87b6-15bfec7b3f6c', '58e7efb7-3064-4a64-b43e-51527a6bfaf3', '1e5cd9f0-756b-481a-99ee-9c004c56a659', 'a58e3a09-b99e-4bd1-8865-ba2a878a5504'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Created reservations ['09ccdd4d-f36f-4fe3-b39c-22df7fe3fa05', 'aae47a43-50ae-445e-9a26-315f61b771ff', 'db01643a-a319-42b4-8a45-ca8b8178946b', '1e18e298-ef42-4f63-bc3b-0eefa3072d44'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:54 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:08:54 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:54 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f" returned: 1 in 0.932s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:54 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:08:54 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:54 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f Jul 01 04:08:54 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "cinder-04746bbf-62d9-4aa0-b8c8-664686e50e2e-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Lock "cinder-04746bbf-62d9-4aa0-b8c8-664686e50e2e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:54 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9d664640-9bea-4237-a2ca-104e4089fd89" returned: 0 in 1.506s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9d664640-9bea-4237-a2ca-104e4089fd89 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "cinder-quobyte-04746bbf-62d9-4aa0-b8c8-664686e50e2e" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:55 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9d664640-9bea-4237-a2ca-104e4089fd89 Jul 01 04:08:55 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Lock "cinder-quobyte-04746bbf-62d9-4aa0-b8c8-664686e50e2e" acquired by "delete_volume" :: waited 0.047s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc612fe-0aaa-4436-bcf0-2fca4623e4a3]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:55 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e Jul 01 04:08:55 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:55 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.012s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:08:55 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Deleted volume successfully. Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-39359ddc-779e-4cd7-89ee-6bd5b9bd38e8 tempest-VolumesTransfersV355Test-2041926064 None] Lock "cinder-a98d65e9-3b58-496d-933f-38d945dd3da6-delete_volume" released by "delete_volume" :: held 3.455s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Flow 'volume_create_manager' (373c0478-4415-4e04-9c65-d467d349347f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11419ba-2cdc-42f1-85e8-207ef3586958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11419ba-2cdc-42f1-85e8-207ef3586958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-414434666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73220b98-f91d-42b7-9c9b-c2acebed358f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec56df8e229f46f3ac8c3688e1235c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:55Z,use_quota=True,user_id='2fd7358d2c8c4616bc05ec56f335a36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727ccb10-2d11-4646-8805-d34b573958d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727ccb10-2d11-4646-8805-d34b573958d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:55 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77033231-2ee7-4d01-87cc-21c1da1948bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77033231-2ee7-4d01-87cc-21c1da1948bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73220b98-f91d-42b7-9c9b-c2acebed358f', 'volume_name': 'volume-73220b98-f91d-42b7-9c9b-c2acebed358f', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34b5fa7-6128-4381-9194-85794a58ab64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34b5fa7-6128-4381-9194-85794a58ab64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68222a1b-4749-47d0-9908-cfe74d1cd8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:55 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Volume 73220b98-f91d-42b7-9c9b-c2acebed358f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73220b98-f91d-42b7-9c9b-c2acebed358f', 'volume_size': 1} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-414434666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73220b98-f91d-42b7-9c9b-c2acebed358f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec56df8e229f46f3ac8c3688e1235c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:55Z,use_quota=True,user_id='2fd7358d2c8c4616bc05ec56f335a36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Creating volume 73220b98-f91d-42b7-9c9b-c2acebed358f {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:08:55 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-73220b98-f91d-42b7-9c9b-c2acebed358f 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-59db7728-fef4-440d-ae10-1ced5e2ebc2f" returned: 0 in 1.131s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Lock "cinder-quobyte-59db7728-fef4-440d-ae10-1ced5e2ebc2f" released by "delete_volume" :: held 3.218s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:55 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-73220b98-f91d-42b7-9c9b-c2acebed358f 1073741824 Jul 01 04:08:55 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Created reservations ['3410a949-1515-4eef-a6ee-5b470828e46a', '89503f15-7bed-4cc6-bf5d-67bab16f6128', '2687125b-7e2e-4fcb-80bb-591d3f796f01', '954d25a4-f38d-4f60-85c0-da3e116baa2f'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:55 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.268s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:08:55 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Deleted volume successfully. Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-73b28028-bc72-42fb-a87d-3051ec0f85ea tempest-AttachVolumeNegativeTest-962019476 None] Lock "cinder-79977376-41ff-4c3c-9171-11abd686a6ab-delete_volume" released by "delete_volume" :: held 3.624s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:55 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:08:55 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:56 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e" returned: 0 in 1.159s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:56 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9d664640-9bea-4237-a2ca-104e4089fd89" returned: 0 in 1.299s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-quobyte-9d664640-9bea-4237-a2ca-104e4089fd89" released by "delete_volume" :: held 2.893s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:56 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e Jul 01 04:08:56 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Created reservations ['e86ef394-7226-4a5a-875f-6594361d9aad', '048d0c61-bee6-42fa-8c99-374920f13433', 'abb39dba-35f3-4c78-9c60-f53545f98c5b', 'a4504b4c-5c80-42b9-a87f-ca4926a81921'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:56 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:08:56 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "cinder-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "cinder-quobyte-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-quobyte-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1" acquired by "delete_volume" :: waited 0.048s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c8076d-4f59-4a6b-9054-d3181437c5ef]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:08:57 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Flow 'volume_create_manager' (24f6edc9-a815-4037-9352-f78f293e9538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:57 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b473478c-f5ee-41c6-ab6b-004f6bddb6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.153s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-73220b98-f91d-42b7-9c9b-c2acebed358f 1073741824" returned: 0 in 1.431s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:08:57 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1 Jul 01 04:08:57 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:57 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:57 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Deleted volume successfully. Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b473478c-f5ee-41c6-ab6b-004f6bddb6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-142329025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff701c42-2210-4107-879c-44ca0c0a1cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19441e81581246f9bd49e79e48217ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:57Z,use_quota=True,user_id='0951e02da37c4b70a43b8c6b1f8c839f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194eb1bc-77b3-4625-9275-dc99f07f3aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194eb1bc-77b3-4625-9275-dc99f07f3aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7595773-216e-4c3e-8f1c-200720cc582b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7595773-216e-4c3e-8f1c-200720cc582b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff701c42-2210-4107-879c-44ca0c0a1cf8', 'volume_name': 'volume-ff701c42-2210-4107-879c-44ca0c0a1cf8', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49057af-b7e6-40e7-8143-38b109bf8cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49057af-b7e6-40e7-8143-38b109bf8cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767ce370-fc2c-41c9-9e0a-d1c8794c155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:57 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Volume ff701c42-2210-4107-879c-44ca0c0a1cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff701c42-2210-4107-879c-44ca0c0a1cf8', 'volume_size': 1} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-04746bbf-62d9-4aa0-b8c8-664686e50e2e" returned: 0 in 0.976s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Lock "cinder-quobyte-04746bbf-62d9-4aa0-b8c8-664686e50e2e" released by "delete_volume" :: held 2.200s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-73220b98-f91d-42b7-9c9b-c2acebed358f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4a2fbc9d-ee96-42e0-95b4-d5cf132d4956 tempest-VolumesExtendTest-1096873957 None] Lock "cinder-59db7728-fef4-440d-ae10-1ced5e2ebc2f-delete_volume" released by "delete_volume" :: held 4.803s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:57 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-73220b98-f91d-42b7-9c9b-c2acebed358f Jul 01 04:08:57 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Created reservations ['e27df258-dcf7-4d3f-ac36-faea733e3ff6', 'e142ce7d-f013-42a5-a772-4f68e0de2723', '3d95a0c1-1703-4fc6-af93-ca27363b5bac', '63c25ecf-05d2-4805-a862-92175b07cb73'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:57 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:08:57 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:57 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.058s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:08:57 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Deleted volume successfully. Jul 01 04:08:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ed1e179e-ef9f-4362-b38c-c65bdb845e44 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-9d664640-9bea-4237-a2ca-104e4089fd89-delete_volume" released by "delete_volume" :: held 4.313s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:57 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:58 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1" returned: 0 in 1.067s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-73220b98-f91d-42b7-9c9b-c2acebed358f" returned: 0 in 0.798s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] <== create_volume: return (2349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.352s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.838s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-142329025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff701c42-2210-4107-879c-44ca0c0a1cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19441e81581246f9bd49e79e48217ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:08:57Z,use_quota=True,user_id='0951e02da37c4b70a43b8c6b1f8c839f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Creating volume ff701c42-2210-4107-879c-44ca0c0a1cf8 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:58 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1 Jul 01 04:08:58 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:08:58 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:58 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 1073741824 Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68222a1b-4749-47d0-9908-cfe74d1cd8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73220b98-f91d-42b7-9c9b-c2acebed358f', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:58 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea7ae9a-6f4c-441d-8465-362e9bb50a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:08:58 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Volume volume-73220b98-f91d-42b7-9c9b-c2acebed358f (73220b98-f91d-42b7-9c9b-c2acebed358f): created successfully Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea7ae9a-6f4c-441d-8465-362e9bb50a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Flow 'volume_create_manager' (373c0478-4415-4e04-9c65-d467d349347f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:08:58 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.710s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:08:58 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-6bd5bd9d-cd03-4ca6-bd9e-504758010afb tempest-VolumesTransfersV355Test-272942894 None] Created volume successfully. Jul 01 04:08:58 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Deleted volume successfully. Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e4a40a56-56ab-47b0-b8bd-2a1ac2548433 tempest-AttachVolumeNegativeTest-962019476 None] Lock "cinder-04746bbf-62d9-4aa0-b8c8-664686e50e2e-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "cinder-118e04cd-7e8a-4edf-930d-12a485038f9d-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Lock "cinder-118e04cd-7e8a-4edf-930d-12a485038f9d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "cinder-quobyte-118e04cd-7e8a-4edf-930d-12a485038f9d" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Lock "cinder-quobyte-118e04cd-7e8a-4edf-930d-12a485038f9d" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:58 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[239f500a-abb9-43b7-b712-fc4977c5feb4]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-118e04cd-7e8a-4edf-930d-12a485038f9d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1" returned: 0 in 0.856s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-quobyte-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1" released by "delete_volume" :: held 2.027s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:58 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Created reservations ['124abadd-57d4-4bb5-9256-a86fe9b130b6', 'a58fa756-52f1-48ea-aad1-dc390cc74484', '6769479d-4138-4aaa-8b47-29303e224115', '8f2b0605-0343-444c-8203-29d87df31cfb'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Acquiring lock "cinder-73220b98-f91d-42b7-9c9b-c2acebed358f-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Lock "cinder-73220b98-f91d-42b7-9c9b-c2acebed358f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:59 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-118e04cd-7e8a-4edf-930d-12a485038f9d Jul 01 04:08:59 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Acquiring lock "cinder-quobyte-73220b98-f91d-42b7-9c9b-c2acebed358f" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:08:59 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:08:59 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Lock "cinder-quobyte-73220b98-f91d-42b7-9c9b-c2acebed358f" acquired by "delete_volume" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:08:59 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 1073741824" returned: 0 in 1.181s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3f87b7-c824-4051-812a-4633ee8bd8c7]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-73220b98-f91d-42b7-9c9b-c2acebed358f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:08:59 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 Jul 01 04:08:59 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:59 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-73220b98-f91d-42b7-9c9b-c2acebed358f Jul 01 04:08:59 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:08:59 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.793s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:08:59 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Deleted volume successfully. Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-39cd4c3d-f1f4-4710-94b5-cb7b189ada97 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-5bcf12fe-1209-4a02-8b7f-c4b0e8d36bd1-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:08:59 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-118e04cd-7e8a-4edf-930d-12a485038f9d" returned: 0 in 1.164s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:08:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-118e04cd-7e8a-4edf-930d-12a485038f9d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:00 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-118e04cd-7e8a-4edf-930d-12a485038f9d Jul 01 04:09:00 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:00 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8" returned: 0 in 0.819s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767ce370-fc2c-41c9-9e0a-d1c8794c155e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff701c42-2210-4107-879c-44ca0c0a1cf8', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:00 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3429bf82-0317-4438-b4b9-5fb9f6866431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-73220b98-f91d-42b7-9c9b-c2acebed358f" returned: 0 in 0.920s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-73220b98-f91d-42b7-9c9b-c2acebed358f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:00 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Volume volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 (ff701c42-2210-4107-879c-44ca0c0a1cf8): created successfully Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3429bf82-0317-4438-b4b9-5fb9f6866431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Flow 'volume_create_manager' (24f6edc9-a815-4037-9352-f78f293e9538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "cinder-803b849e-7ce1-4114-ae97-4aba89a0ab7a-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:00 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-73220b98-f91d-42b7-9c9b-c2acebed358f Jul 01 04:09:00 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:00 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-63d2ba20-1519-4a76-806e-a57fc8891589 tempest-VolumesExtendTest-1096873957 None] Created volume successfully. Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-803b849e-7ce1-4114-ae97-4aba89a0ab7a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "cinder-quobyte-803b849e-7ce1-4114-ae97-4aba89a0ab7a" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-quobyte-803b849e-7ce1-4114-ae97-4aba89a0ab7a" acquired by "delete_volume" :: waited 0.022s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[0874ed7e-6dc5-4747-80c9-2bb81f367ff6]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:00 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a Jul 01 04:09:00 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:00 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-118e04cd-7e8a-4edf-930d-12a485038f9d" returned: 0 in 0.809s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Lock "cinder-quobyte-118e04cd-7e8a-4edf-930d-12a485038f9d" released by "delete_volume" :: held 2.040s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Created reservations ['677907e1-755a-45b8-adf3-fcd1eb0d5947', 'a6045583-03b2-4bb6-b121-d27b07acc521', '4d257248-2226-40ef-8e60-09cc7200909b', 'e2002425-bbef-4d5a-b1d5-3c5c5eab801a'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:09:00 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-73220b98-f91d-42b7-9c9b-c2acebed358f" returned: 0 in 0.810s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Lock "cinder-quobyte-73220b98-f91d-42b7-9c9b-c2acebed358f" released by "delete_volume" :: held 1.792s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:01 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:09:01 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Created reservations ['c06aeb7c-205a-43da-a894-79bea6919646', '70075d23-3a5c-4af8-bc9f-929dc072f655', '92651193-88e3-402f-a176-1f3d1173f170', 'c4e021e0-1180-4189-a336-da66aaa25adf'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:01 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a" returned: 0 in 0.821s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:01 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:09:01 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:01 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a Jul 01 04:09:01 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] Creating offline snapshot 46341acc-3366-4c91-8798-55236e7acab9 of volume ff701c42-2210-4107-879c-44ca0c0a1cf8 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f099402-3653-4683-a8f2-a6f33e99f133]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:01 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 Jul 01 04:09:01 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:02 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.133s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:09:02 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Deleted volume successfully. Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b7af60f3-c486-40a4-b758-520e49a4c4fa tempest-AttachVolumeNegativeTest-962019476 None] Lock "cinder-118e04cd-7e8a-4edf-930d-12a485038f9d-delete_volume" released by "delete_volume" :: held 3.501s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:02 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-803b849e-7ce1-4114-ae97-4aba89a0ab7a" returned: 0 in 1.086s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:02 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.115s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-quobyte-803b849e-7ce1-4114-ae97-4aba89a0ab7a" released by "delete_volume" :: held 1.963s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:02 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Deleted volume successfully. Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-773e7018-86b7-4814-8627-04d5aa2e1f0e tempest-VolumesTransfersV355Test-2041926064 None] Lock "cinder-73220b98-f91d-42b7-9c9b-c2acebed358f-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Created reservations ['a2598248-3103-4af7-bdbe-fa70eee83396', '995f4151-3368-4503-a057-7d63c6f2c187', '32487db4-3627-4b34-bc0f-c40f238aa5f4', '5240b42f-0a60-46bf-b976-7a66f2e11567'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:02 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:09:02 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "cinder-e0cc050d-5edf-4a14-ba08-a21dce8e05c4-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-e0cc050d-5edf-4a14-ba08-a21dce8e05c4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:02 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8" returned: 0 in 1.191s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "cinder-quobyte-e0cc050d-5edf-4a14-ba08-a21dce8e05c4" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-quobyte-e0cc050d-5edf-4a14-ba08-a21dce8e05c4" acquired by "delete_volume" :: waited 0.029s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:02 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 1G Jul 01 04:09:02 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[18200513-05b9-4c6b-af07-d8809735149d]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:03 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4 Jul 01 04:09:03 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:03 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.957s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:03 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:09:03 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Deleted volume successfully. Jul 01 04:09:03 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3c87e60c-3a13-47ad-a0fe-ff56731785b6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-803b849e-7ce1-4114-ae97-4aba89a0ab7a-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:04 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 1G" returned: 0 in 1.271s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:04 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 Jul 01 04:09:04 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:04 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4" returned: 0 in 1.270s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:04 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4 Jul 01 04:09:04 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:04 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9" returned: 0 in 0.974s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:04 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 is being set with open permissions: ugo+rw Jul 01 04:09:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:05 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 Jul 01 04:09:05 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:05 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e0cc050d-5edf-4a14-ba08-a21dce8e05c4" returned: 0 in 0.936s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-quobyte-e0cc050d-5edf-4a14-ba08-a21dce8e05c4" released by "delete_volume" :: held 2.277s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:05 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Created reservations ['7e72d243-c87d-4432-ab0f-ebfeacebb152', '52f743b7-18a2-4e3e-80d0-c4fb7e9a1abd', '58ff54a3-b905-41b6-a991-5653e39b2755', 'bb43e8c6-eac2-4c88-b5d7-14acad31f212'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:09:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:05 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:09:05 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:05 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9" returned: 0 in 0.856s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:05 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.info Jul 01 04:09:05 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:06 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.936s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:06 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:09:06 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Deleted volume successfully. Jul 01 04:09:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7bb714ef-fe9c-4e69-a15c-d11519fc5ea6 tempest-CreateVolumesFromSourceVolumeTest-1647410297 None] Lock "cinder-e0cc050d-5edf-4a14-ba08-a21dce8e05c4-delete_volume" released by "delete_volume" :: held 3.551s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:06 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.info" returned: 0 in 1.118s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:07 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.info is being set with open permissions: ugo+rw Jul 01 04:09:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:07 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.info Jul 01 04:09:07 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:07 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.info" returned: 0 in 0.754s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.292s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:07 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-71f1dcd3-abe4-4955-9bde-efc3d1a01023 tempest-VolumesExtendTest-1096873957 None] Create snapshot completed successfully Jul 01 04:09:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d568d299-09f5-48cd-8b43-c6c88c0ee4d8 tempest-VolumesExtendTest-1096873957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d568d299-09f5-48cd-8b43-c6c88c0ee4d8 tempest-VolumesExtendTest-1096873957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:09 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[24575710-7469-4b96-a1ce-47fbdba450e3]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d568d299-09f5-48cd-8b43-c6c88c0ee4d8 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:09 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 Jul 01 04:09:09 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:10 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d568d299-09f5-48cd-8b43-c6c88c0ee4d8 tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8" returned: 0 in 1.080s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d568d299-09f5-48cd-8b43-c6c88c0ee4d8 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 2G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d568d299-09f5-48cd-8b43-c6c88c0ee4d8 tempest-VolumesExtendTest-1096873957 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 2G" returned: 0 in 0.167s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d568d299-09f5-48cd-8b43-c6c88c0ee4d8 tempest-VolumesExtendTest-1096873957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.308s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:10 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d568d299-09f5-48cd-8b43-c6c88c0ee4d8 tempest-VolumesExtendTest-1096873957 None] Extend volume completed successfully. Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Flow 'volume_create_manager' (40ae6d84-e5f1-42d6-bb93-1b68f14ae1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73c7cec-5e97-4610-993f-4a70e02336ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73c7cec-5e97-4610-993f-4a70e02336ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1791356377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcc4513-9e2c-4a80-9cd0-9feed1113397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2684d4cb1a7c477e88217d73019ecf9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:11Z,use_quota=True,user_id='9a5f786f3f574c9d90f0c1f8b90a0429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5e84d3-e44f-4291-bb4a-a0553291617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5e84d3-e44f-4291-bb4a-a0553291617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1347b22b-cc51-4e8b-bfee-32726e1135dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1347b22b-cc51-4e8b-bfee-32726e1135dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbcc4513-9e2c-4a80-9cd0-9feed1113397', 'volume_name': 'volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458bf1e0-c175-4fac-8849-d92e6d2f595b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458bf1e0-c175-4fac-8849-d92e6d2f595b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37013db-0487-499a-9f91-20f3054183ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:11 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Volume dbcc4513-9e2c-4a80-9cd0-9feed1113397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397', 'volume_size': 1} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1791356377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcc4513-9e2c-4a80-9cd0-9feed1113397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2684d4cb1a7c477e88217d73019ecf9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:11Z,use_quota=True,user_id='9a5f786f3f574c9d90f0c1f8b90a0429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Creating volume dbcc4513-9e2c-4a80-9cd0-9feed1113397 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:09:11 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:11 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 1073741824 Jul 01 04:09:11 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Acquiring lock "cinder-46341acc-3366-4c91-8798-55236e7acab9-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Lock "cinder-46341acc-3366-4c91-8798-55236e7acab9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Acquiring lock "cinder-quobyte-ff701c42-2210-4107-879c-44ca0c0a1cf8" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Lock "cinder-quobyte-ff701c42-2210-4107-879c-44ca0c0a1cf8" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Acquiring lock "cinder-quobyte-46341acc-3366-4c91-8798-55236e7acab9" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Lock "cinder-quobyte-46341acc-3366-4c91-8798-55236e7acab9" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Deleting offline snapshot 46341acc-3366-4c91-8798-55236e7acab9 of volume ff701c42-2210-4107-879c-44ca0c0a1cf8 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] snapshot_file for this snap is: volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f13935-aebd-476c-a014-8514e3892c76]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:11 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 Jul 01 04:09:11 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Flow 'volume_create_manager' (81df9aba-332e-4821-8b44-51fbc656355a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac0e347-a729-4681-ac3c-0c2e39b75bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac0e347-a729-4681-ac3c-0c2e39b75bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1869100935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e34daab-80df-4e75-8a71-c693c0b00533,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ebae24ce1854cc3bbc984954bf12154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:12Z,use_quota=True,user_id='5e166a8ba06d4088a615aa48e8e95e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be3c759-85bb-4605-91b5-ba47cac088db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be3c759-85bb-4605-91b5-ba47cac088db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c62900c-2628-4c6c-8e4f-e754db4ad9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c62900c-2628-4c6c-8e4f-e754db4ad9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e34daab-80df-4e75-8a71-c693c0b00533', 'volume_name': 'volume-4e34daab-80df-4e75-8a71-c693c0b00533', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba98fa3c-baca-4a90-8245-0c09908e5ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:12 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba98fa3c-baca-4a90-8245-0c09908e5ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d333207d-62f8-4021-b01d-37f90b03f635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:12 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Volume 4e34daab-80df-4e75-8a71-c693c0b00533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e34daab-80df-4e75-8a71-c693c0b00533', 'volume_size': 1} Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 1073741824" returned: 0 in 1.202s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:12 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 Jul 01 04:09:12 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:12 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9" returned: 0 in 0.891s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff701c42-2210-4107-879c-44ca0c0a1cf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51aafbf-11b3-4ee4-bcc0-97fce660d01b]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:12 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 Jul 01 04:09:12 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:13 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397" returned: 0 in 0.662s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1869100935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e34daab-80df-4e75-8a71-c693c0b00533,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ebae24ce1854cc3bbc984954bf12154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:12Z,use_quota=True,user_id='5e166a8ba06d4088a615aa48e8e95e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Creating volume 4e34daab-80df-4e75-8a71-c693c0b00533 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:09:13 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4e34daab-80df-4e75-8a71-c693c0b00533 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37013db-0487-499a-9f91-20f3054183ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:13 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4e34daab-80df-4e75-8a71-c693c0b00533 1073741824 Jul 01 04:09:13 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277d246e-e7ff-4e26-9ace-3de380e6b03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:13 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Volume volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 (dbcc4513-9e2c-4a80-9cd0-9feed1113397): created successfully Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277d246e-e7ff-4e26-9ace-3de380e6b03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Flow 'volume_create_manager' (40ae6d84-e5f1-42d6-bb93-1b68f14ae1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:13 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-ec049fcc-1b75-43a0-bd13-f0cf26e70206 tempest-VolumeDependencyTests-207662490 None] Created volume successfully. Jul 01 04:09:13 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8" returned: 0 in 0.904s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:13 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 Jul 01 04:09:13 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:14 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4e34daab-80df-4e75-8a71-c693c0b00533 1073741824" returned: 0 in 1.012s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4e34daab-80df-4e75-8a71-c693c0b00533 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:14 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4e34daab-80df-4e75-8a71-c693c0b00533 Jul 01 04:09:14 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:14 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9" returned: 0 in 1.055s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:14 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9 Jul 01 04:09:14 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:15 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4e34daab-80df-4e75-8a71-c693c0b00533" returned: 0 in 1.008s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.533s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d333207d-62f8-4021-b01d-37f90b03f635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e34daab-80df-4e75-8a71-c693c0b00533', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ffcae5-eb64-4df8-8f38-6222202304d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] Creating offline snapshot bedabf7b-03dc-4704-b9c0-16db51efb30b of volume dbcc4513-9e2c-4a80-9cd0-9feed1113397 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:09:15 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Volume volume-4e34daab-80df-4e75-8a71-c693c0b00533 (4e34daab-80df-4e75-8a71-c693c0b00533): created successfully Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ffcae5-eb64-4df8-8f38-6222202304d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Flow 'volume_create_manager' (81df9aba-332e-4821-8b44-51fbc656355a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4642d7fe-abf6-4fb8-b205-fe8a70a4d800]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:15 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-3b1d2d70-04b1-4a63-b22b-a20a75b98878 tempest-VolumesTestJSON-829016062 None] Created volume successfully. Jul 01 04:09:15 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 Jul 01 04:09:15 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:15 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8.46341acc-3366-4c91-8798-55236e7acab9" returned: 0 in 0.850s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Lock "cinder-quobyte-46341acc-3366-4c91-8798-55236e7acab9" released by "_delete_snapshot" :: held 3.859s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Lock "cinder-quobyte-ff701c42-2210-4107-879c-44ca0c0a1cf8" released by "delete_snapshot" :: held 3.902s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Created reservations ['5600d922-1843-4d24-a8f2-30015f1a72a8', 'c9c5555f-9c2d-42be-9b86-16fd3390e4f3', 'ec21cc17-d53c-4d4e-8485-295a81fa68ac', '2eeefc32-639f-4330-bf9c-d48c7b1edbd4'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:09:15 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Delete snapshot completed successfully. Jul 01 04:09:15 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c064d90-1bcb-472c-879f-8bc62bb51542 tempest-VolumesExtendTest-1096873957 None] Lock "cinder-46341acc-3366-4c91-8798-55236e7acab9-delete_snapshot" released by "delete_snapshot" :: held 4.183s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Acquiring lock "cinder-ff701c42-2210-4107-879c-44ca0c0a1cf8-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Lock "cinder-ff701c42-2210-4107-879c-44ca0c0a1cf8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Acquiring lock "cinder-quobyte-ff701c42-2210-4107-879c-44ca0c0a1cf8" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Lock "cinder-quobyte-ff701c42-2210-4107-879c-44ca0c0a1cf8" acquired by "delete_volume" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf02902-cc16-49ef-be0c-a6b632a43610]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:09:16 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Flow 'volume_create_manager' (737bd091-976c-4dc5-9ad6-d7136f205e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209fbaf2-cb4b-4439-9b60-e1ba045d103f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397" returned: 0 in 1.123s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:16 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 Jul 01 04:09:16 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209fbaf2-cb4b-4439-9b60-e1ba045d103f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2114454743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4345223a-1952-49a5-96c5-28dc832c68cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ebae24ce1854cc3bbc984954bf12154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:16Z,use_quota=True,user_id='5e166a8ba06d4088a615aa48e8e95e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522fcc69-04ff-4bc8-9afa-cd6b13566f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522fcc69-04ff-4bc8-9afa-cd6b13566f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:16 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b 1G Jul 01 04:09:16 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b75183f-42d7-4a89-9091-3816d5eef899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b75183f-42d7-4a89-9091-3816d5eef899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4345223a-1952-49a5-96c5-28dc832c68cc', 'volume_name': 'volume-4345223a-1952-49a5-96c5-28dc832c68cc', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aaf2620-fb5b-40c9-a463-95e7e32e6aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aaf2620-fb5b-40c9-a463-95e7e32e6aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a214e0-70bc-4bd6-8302-4ca657017743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:16 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Volume 4345223a-1952-49a5-96c5-28dc832c68cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4345223a-1952-49a5-96c5-28dc832c68cc', 'volume_size': 1} Jul 01 04:09:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:17 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8" returned: 0 in 0.912s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:17 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8 Jul 01 04:09:17 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:17 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b 1G" returned: 0 in 0.981s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:17 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b Jul 01 04:09:17 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:18 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ff701c42-2210-4107-879c-44ca0c0a1cf8" returned: 0 in 0.856s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:18 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Lock "cinder-quobyte-ff701c42-2210-4107-879c-44ca0c0a1cf8" released by "delete_volume" :: held 1.866s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:18 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Created reservations ['6051f8e2-959d-4e7c-82b0-590368f73c13', 'd590106f-a15d-46ef-b910-8f7619da14a2', '43e7fa09-3219-4a5a-950e-98289f9aa00c', 'b3b240d7-6fc1-4541-b6fc-6058c18a584b'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:09:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:18 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:09:18 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:18 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b" returned: 0 in 1.047s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:18 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b is being set with open permissions: ugo+rw Jul 01 04:09:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:18 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b Jul 01 04:09:18 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:19 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.824s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:19 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:09:19 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Deleted volume successfully. Jul 01 04:09:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8bb052a7-3480-40b0-a6d7-e122abc70cfa tempest-VolumesExtendTest-1096873957 None] Lock "cinder-ff701c42-2210-4107-879c-44ca0c0a1cf8-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:19 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b" returned: 0 in 0.867s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:19 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.info Jul 01 04:09:19 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:20 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.info" returned: 0 in 0.747s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:20 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.info is being set with open permissions: ugo+rw Jul 01 04:09:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:20 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.info Jul 01 04:09:20 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:20 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.info" returned: 0 in 0.818s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.748s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.471s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2114454743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4345223a-1952-49a5-96c5-28dc832c68cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ebae24ce1854cc3bbc984954bf12154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:16Z,use_quota=True,user_id='5e166a8ba06d4088a615aa48e8e95e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:09:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Creating volume 4345223a-1952-49a5-96c5-28dc832c68cc {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:09:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:09:20 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:09:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4345223a-1952-49a5-96c5-28dc832c68cc 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:20 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4345223a-1952-49a5-96c5-28dc832c68cc 1073741824 Jul 01 04:09:20 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:20 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-b3041afc-3a2f-44c4-8c5f-9644d8b8a8aa tempest-VolumeDependencyTests-207662490 None] Create snapshot completed successfully Jul 01 04:09:21 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4345223a-1952-49a5-96c5-28dc832c68cc 1073741824" returned: 0 in 1.023s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4345223a-1952-49a5-96c5-28dc832c68cc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:21 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4345223a-1952-49a5-96c5-28dc832c68cc Jul 01 04:09:21 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Flow 'volume_create_manager' (c5a55398-269a-45cb-b2f4-6d7d4af668ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea911a6f-79dd-41d1-a5e4-212dda63a638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea911a6f-79dd-41d1-a5e4-212dda63a638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-703647820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c23db0ad-6498-455b-a3f0-b705c32f09cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab75d61caa44e2bbc34e01d1de45e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:22Z,use_quota=True,user_id='1fb0cd2b4e68498d9660c9f1ca6f33ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727a4c43-024a-45c5-b3ff-57a0f67dbe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727a4c43-024a-45c5-b3ff-57a0f67dbe59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55872d5e-9e68-45e8-80c7-ef8c9bd1f62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55872d5e-9e68-45e8-80c7-ef8c9bd1f62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c23db0ad-6498-455b-a3f0-b705c32f09cd', 'volume_name': 'volume-c23db0ad-6498-455b-a3f0-b705c32f09cd', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee03a1ef-649e-4eb7-9ebc-83e75b24f996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee03a1ef-649e-4eb7-9ebc-83e75b24f996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5338401e-6f36-4792-9949-760b4fb15904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Volume c23db0ad-6498-455b-a3f0-b705c32f09cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c23db0ad-6498-455b-a3f0-b705c32f09cd', 'volume_size': 1} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Flow 'volume_create_manager' (2d0b089d-84f6-401a-84b6-0d629a850561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4a7650-6a35-4f4b-a69c-50e2f207d080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4a7650-6a35-4f4b-a69c-50e2f207d080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1509383846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d7ba9d-fddd-46dc-8749-b71638bb2dd6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='741b5c86a9ca4b9b9b2b96407ba3c709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:22Z,use_quota=True,user_id='81ac2227c0b94506aab0f2ce698f694d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba4d911-0eeb-42e8-9f15-ce5e2078a0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba4d911-0eeb-42e8-9f15-ce5e2078a0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f84cad5-2ea8-4140-a6a5-b236d64ec6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f84cad5-2ea8-4140-a6a5-b236d64ec6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d7ba9d-fddd-46dc-8749-b71638bb2dd6', 'volume_name': 'volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e41543d-d111-4bce-9351-e1d6ea77dbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e41543d-d111-4bce-9351-e1d6ea77dbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4d021f-fc28-4c52-ba82-99d8836849ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Volume 87d7ba9d-fddd-46dc-8749-b71638bb2dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6', 'volume_size': 1} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:22 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4345223a-1952-49a5-96c5-28dc832c68cc" returned: 0 in 0.748s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.130s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-703647820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c23db0ad-6498-455b-a3f0-b705c32f09cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab75d61caa44e2bbc34e01d1de45e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:22Z,use_quota=True,user_id='1fb0cd2b4e68498d9660c9f1ca6f33ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Creating volume c23db0ad-6498-455b-a3f0-b705c32f09cd {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:09:22 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:22 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd 1073741824 Jul 01 04:09:22 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a214e0-70bc-4bd6-8302-4ca657017743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4345223a-1952-49a5-96c5-28dc832c68cc', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28203d9-793c-4c12-8f9c-abc45e299c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:09:22 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Volume volume-4345223a-1952-49a5-96c5-28dc832c68cc (4345223a-1952-49a5-96c5-28dc832c68cc): created successfully Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28203d9-793c-4c12-8f9c-abc45e299c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Flow 'volume_create_manager' (737bd091-976c-4dc5-9ad6-d7136f205e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Flow 'volume_create_manager' (3a0a8b00-df5e-4e63-a569-0c0e6095a2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91cec709-b654-4ad2-8ebd-38020671e0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91cec709-b654-4ad2-8ebd-38020671e0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-991910124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5213484d-7e98-4ca6-8dbb-e0c42a5605c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2684d4cb1a7c477e88217d73019ecf9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bedabf7b-03dc-4704-b9c0-16db51efb30b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:23Z,use_quota=True,user_id='9a5f786f3f574c9d90f0c1f8b90a0429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb61278-d83b-4de5-9eea-51858e99fb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb61278-d83b-4de5-9eea-51858e99fb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806f71f6-43a5-4602-8f2e-343015b5a3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806f71f6-43a5-4602-8f2e-343015b5a3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5213484d-7e98-4ca6-8dbb-e0c42a5605c8', 'volume_name': 'volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8', 'volume_size': 1, 'snapshot_id': 'bedabf7b-03dc-4704-b9c0-16db51efb30b'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d2215c-51a5-4c85-8e6e-825a557101b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d2215c-51a5-4c85-8e6e-825a557101b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcbfce0-3fd4-45af-9c5c-e6ab8b129ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:22 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Volume 5213484d-7e98-4ca6-8dbb-e0c42a5605c8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8', 'volume_size': 1, 'snapshot_id': 'bedabf7b-03dc-4704-b9c0-16db51efb30b'} Jul 01 04:09:22 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-13d2e0e3-ed29-4ad5-b300-36a55c54ac1c tempest-VolumesTestJSON-829016062 None] Created volume successfully. Jul 01 04:09:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:23 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd 1073741824" returned: 0 in 0.823s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:23 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd Jul 01 04:09:23 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Flow 'volume_create_manager' (0f577bed-328a-4edf-8ee3-2529684c1fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a98d46-721d-4895-bc16-b32929b5a9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a98d46-721d-4895-bc16-b32929b5a9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1286983530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c25df4-ed03-426a-814e-f65c5490fea2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ebae24ce1854cc3bbc984954bf12154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:24Z,use_quota=True,user_id='5e166a8ba06d4088a615aa48e8e95e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df046c8-7e51-4a2a-8eea-1c576748c821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df046c8-7e51-4a2a-8eea-1c576748c821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b482d2-55fe-4c83-aad2-c3f66f24168e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b482d2-55fe-4c83-aad2-c3f66f24168e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5c25df4-ed03-426a-814e-f65c5490fea2', 'volume_name': 'volume-f5c25df4-ed03-426a-814e-f65c5490fea2', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270adca8-3b5a-464b-ad66-efabe5948b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270adca8-3b5a-464b-ad66-efabe5948b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b106cf0f-c617-46f2-8345-a49dd9d2c2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:24 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Volume f5c25df4-ed03-426a-814e-f65c5490fea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5c25df4-ed03-426a-814e-f65c5490fea2', 'volume_size': 1} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:24 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd" returned: 0 in 0.699s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.609s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1509383846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d7ba9d-fddd-46dc-8749-b71638bb2dd6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='741b5c86a9ca4b9b9b2b96407ba3c709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:22Z,use_quota=True,user_id='81ac2227c0b94506aab0f2ce698f694d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Creating volume 87d7ba9d-fddd-46dc-8749-b71638bb2dd6 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:09:24 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5338401e-6f36-4792-9949-760b4fb15904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c23db0ad-6498-455b-a3f0-b705c32f09cd', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e00ac62-cfd3-44ae-ace5-4da16af616f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:24 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6 1073741824 Jul 01 04:09:24 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:24 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Volume volume-c23db0ad-6498-455b-a3f0-b705c32f09cd (c23db0ad-6498-455b-a3f0-b705c32f09cd): created successfully Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e00ac62-cfd3-44ae-ace5-4da16af616f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Flow 'volume_create_manager' (c5a55398-269a-45cb-b2f4-6d7d4af668ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:24 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-b0d683a8-6920-4670-a1b0-15ec361bd5ee tempest-VolumesActionsTest-971335995 None] Created volume successfully. Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:24 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:09:24 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:25 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6 1073741824" returned: 0 in 0.846s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:25 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.686s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:09:25 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6 Jul 01 04:09:25 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:25 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6" returned: 0 in 0.705s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Acquiring lock "cinder-quobyte-bedabf7b-03dc-4704-b9c0-16db51efb30b-5213484d-7e98-4ca6-8dbb-e0c42a5605c8" by "_create_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4d021f-fc28-4c52-ba82-99d8836849ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383d8d80-52f8-48ba-97b4-ea0f5c217162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Lock "cinder-quobyte-bedabf7b-03dc-4704-b9c0-16db51efb30b-5213484d-7e98-4ca6-8dbb-e0c42a5605c8" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Creating volume 5213484d-7e98-4ca6-8dbb-e0c42a5605c8 from snapshot bedabf7b-03dc-4704-b9c0-16db51efb30b {{(pid=86177) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Acquiring lock "cinder-quobyte-5213484d-7e98-4ca6-8dbb-e0c42a5605c8" by "_copy_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:25 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Volume volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6 (87d7ba9d-fddd-46dc-8749-b71638bb2dd6): created successfully Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383d8d80-52f8-48ba-97b4-ea0f5c217162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Flow 'volume_create_manager' (2d0b089d-84f6-401a-84b6-0d629a850561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Lock "cinder-quobyte-5213484d-7e98-4ca6-8dbb-e0c42a5605c8" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] snapshot: bedabf7b-03dc-4704-b9c0-16db51efb30b, volume: 5213484d-7e98-4ca6-8dbb-e0c42a5605c8, {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 04:09:25 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-2f88090c-d095-4f34-8b6e-dee2ce819b12 tempest-VolumesListTestJSON-306781893 None] Created volume successfully. Jul 01 04:09:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:26 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e0a15e-d60b-46be-b756-113138b09970]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:26 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b Jul 01 04:09:26 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:26 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b" returned: 0 in 0.847s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:09:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 04:09:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Creating direct copy from snapshot {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 04:09:26 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfa7f6c-d615-4b65-a66c-3c6cb9e2fe57]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:27 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:09:27 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 Jul 01 04:09:27 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Flow 'volume_create_manager' (8a7f8e83-91d4-47b9-a534-bfd67ce28aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be864080-9d63-4ded-a24a-bbbf84b1a3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be864080-9d63-4ded-a24a-bbbf84b1a3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1712921185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac16b173-c86e-4a5c-8460-2f146fd4d7d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='741b5c86a9ca4b9b9b2b96407ba3c709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:27Z,use_quota=True,user_id='81ac2227c0b94506aab0f2ce698f694d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106c630c-0885-47f8-a09e-200cf8a96ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106c630c-0885-47f8-a09e-200cf8a96ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41e3c31-a15b-4bc2-be05-bbb6945fb25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41e3c31-a15b-4bc2-be05-bbb6945fb25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac16b173-c86e-4a5c-8460-2f146fd4d7d1', 'volume_name': 'volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb56a850-2d3b-4c92-8287-245e6c4a6683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb56a850-2d3b-4c92-8287-245e6c4a6683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf83ec6-3a86-4ee0-9163-7128b856afd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:27 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Volume ac16b173-c86e-4a5c-8460-2f146fd4d7d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1', 'volume_size': 1} Jul 01 04:09:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:27 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397" returned: 0 in 0.790s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:27 devstack cinder-volume[86177]: DEBUG cinder.utils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Path /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8 not found in is_blk_device check {{(pid=86177) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 04:09:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:27 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8 Jul 01 04:09:27 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:33 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8" returned: 0 in 5.430s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:33 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6407b0ec-031c-49e2-8055-75b6fa9c8bec]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:33 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 Jul 01 04:09:33 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:34 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397" returned: 0 in 1.024s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Image conversion details: src /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397, size 1024.00 MB, duration 5.43 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:09:34 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Converted 1024.00 MB image at 188.53 MB/s Jul 01 04:09:34 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8 is being set with open permissions: ugo+rw Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:34 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8 Jul 01 04:09:34 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:34 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8" returned: 0 in 0.717s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Lock "cinder-quobyte-5213484d-7e98-4ca6-8dbb-e0c42a5605c8" released by "_copy_volume_from_snapshot" :: held 8.956s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Lock "cinder-quobyte-bedabf7b-03dc-4704-b9c0-16db51efb30b-5213484d-7e98-4ca6-8dbb-e0c42a5605c8" released by "_create_volume_from_snapshot" :: held 9.024s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.064s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.686s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1286983530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c25df4-ed03-426a-814e-f65c5490fea2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ebae24ce1854cc3bbc984954bf12154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:24Z,use_quota=True,user_id='5e166a8ba06d4088a615aa48e8e95e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Creating volume f5c25df4-ed03-426a-814e-f65c5490fea2 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:09:34 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:09:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f5c25df4-ed03-426a-814e-f65c5490fea2 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:35 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f5c25df4-ed03-426a-814e-f65c5490fea2 1073741824 Jul 01 04:09:35 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcbfce0-3fd4-45af-9c5c-e6ab8b129ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8', 'volume_size': 1, 'snapshot_id': 'bedabf7b-03dc-4704-b9c0-16db51efb30b'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf5cbbd-8b2e-40fa-b6d7-bbdcffbb8325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:35 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Volume volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8 (5213484d-7e98-4ca6-8dbb-e0c42a5605c8): created successfully Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf5cbbd-8b2e-40fa-b6d7-bbdcffbb8325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Flow 'volume_create_manager' (3a0a8b00-df5e-4e63-a569-0c0e6095a2ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:35 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c916c099-057b-42df-9b01-1dd2f3e5e0d0 tempest-VolumeDependencyTests-207662490 None] Created volume successfully. Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Acquiring lock "cinder-bedabf7b-03dc-4704-b9c0-16db51efb30b-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Lock "cinder-bedabf7b-03dc-4704-b9c0-16db51efb30b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Acquiring lock "cinder-quobyte-dbcc4513-9e2c-4a80-9cd0-9feed1113397" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Lock "cinder-quobyte-dbcc4513-9e2c-4a80-9cd0-9feed1113397" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Acquiring lock "cinder-quobyte-bedabf7b-03dc-4704-b9c0-16db51efb30b" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:35 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Lock "cinder-quobyte-bedabf7b-03dc-4704-b9c0-16db51efb30b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Deleting offline snapshot bedabf7b-03dc-4704-b9c0-16db51efb30b of volume dbcc4513-9e2c-4a80-9cd0-9feed1113397 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] snapshot_file for this snap is: volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f5c25df4-ed03-426a-814e-f65c5490fea2 1073741824" returned: 0 in 0.905s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b9936f-aea2-42e2-8a4b-fc58cc6e95ac]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f5c25df4-ed03-426a-814e-f65c5490fea2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:35 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f5c25df4-ed03-426a-814e-f65c5490fea2 Jul 01 04:09:35 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:36 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b Jul 01 04:09:36 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:36 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f5c25df4-ed03-426a-814e-f65c5490fea2" returned: 0 in 0.713s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.508s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1712921185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac16b173-c86e-4a5c-8460-2f146fd4d7d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='741b5c86a9ca4b9b9b2b96407ba3c709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:27Z,use_quota=True,user_id='81ac2227c0b94506aab0f2ce698f694d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Creating volume ac16b173-c86e-4a5c-8460-2f146fd4d7d1 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:09:36 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:36 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1 1073741824 Jul 01 04:09:36 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b106cf0f-c617-46f2-8345-a49dd9d2c2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5c25df4-ed03-426a-814e-f65c5490fea2', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:36 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0d4106-6862-4ffc-ae4e-25af8056070b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b" returned: 0 in 0.820s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:09:36 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Volume volume-f5c25df4-ed03-426a-814e-f65c5490fea2 (f5c25df4-ed03-426a-814e-f65c5490fea2): created successfully Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0d4106-6862-4ffc-ae4e-25af8056070b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Flow 'volume_create_manager' (0f577bed-328a-4edf-8ee3-2529684c1fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[81819e26-ff9a-4ffc-a636-a21af44a4572]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:36 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-3ecfd2fb-9aa7-4281-a6fa-540598612971 tempest-VolumesTestJSON-829016062 None] Created volume successfully. Jul 01 04:09:36 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 Jul 01 04:09:36 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:37 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:37 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397" returned: 0 in 0.962s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1 1073741824" returned: 0 in 1.064s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:37 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b Jul 01 04:09:37 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:37 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1 Jul 01 04:09:37 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Acquiring lock "cinder-f5c25df4-ed03-426a-814e-f65c5490fea2-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Lock "cinder-f5c25df4-ed03-426a-814e-f65c5490fea2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Acquiring lock "cinder-quobyte-f5c25df4-ed03-426a-814e-f65c5490fea2" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Lock "cinder-quobyte-f5c25df4-ed03-426a-814e-f65c5490fea2" acquired by "delete_volume" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c420136-437a-4ee0-adb6-a91fe4f9bdc6]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f5c25df4-ed03-426a-814e-f65c5490fea2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:38 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f5c25df4-ed03-426a-814e-f65c5490fea2 Jul 01 04:09:38 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:38 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1" returned: 0 in 0.715s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf83ec6-3a86-4ee0-9163-7128b856afd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085a4e17-cb8d-4cfb-98c6-546a87615eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:38 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b" returned: 0 in 0.791s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:38 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Volume volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1 (ac16b173-c86e-4a5c-8460-2f146fd4d7d1): created successfully Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085a4e17-cb8d-4cfb-98c6-546a87615eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Flow 'volume_create_manager' (8a7f8e83-91d4-47b9-a534-bfd67ce28aa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:38 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b Jul 01 04:09:38 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:38 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=177,cinder:SELECT=119,cinder:INSERT=35,cinder:DELETE=16 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:09:38 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-856ff307-dfa2-4221-932c-d9d6e503537b tempest-VolumesListTestJSON-306781893 None] Created volume successfully. Jul 01 04:09:39 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f5c25df4-ed03-426a-814e-f65c5490fea2" returned: 0 in 0.797s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f5c25df4-ed03-426a-814e-f65c5490fea2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:39 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f5c25df4-ed03-426a-814e-f65c5490fea2 Jul 01 04:09:39 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397.bedabf7b-03dc-4704-b9c0-16db51efb30b" returned: 0 in 0.787s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:39 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:39 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=157,cinder:SELECT=123,cinder:INSERT=50,cinder:DELETE=16 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:09:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Lock "cinder-quobyte-bedabf7b-03dc-4704-b9c0-16db51efb30b" released by "_delete_snapshot" :: held 3.530s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Lock "cinder-quobyte-dbcc4513-9e2c-4a80-9cd0-9feed1113397" released by "delete_snapshot" :: held 3.584s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:39 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Created reservations ['6dbd7859-d67e-44b8-af94-c2137eb4c153', '7997d927-4856-4d99-906a-2f8034ae1eda', 'b319c65b-f3df-4cf1-a258-c022f8bc9421', '4b6de6b1-bb27-4212-8a82-9bc79aa7f0a9'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:09:39 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Delete snapshot completed successfully. Jul 01 04:09:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3b53ebf9-6b14-4267-844e-b544e1a341fb tempest-VolumeDependencyTests-207662490 None] Lock "cinder-bedabf7b-03dc-4704-b9c0-16db51efb30b-delete_snapshot" released by "delete_snapshot" :: held 3.820s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:40 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f5c25df4-ed03-426a-814e-f65c5490fea2" returned: 0 in 1.039s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Lock "cinder-quobyte-f5c25df4-ed03-426a-814e-f65c5490fea2" released by "delete_volume" :: held 1.890s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Acquiring lock "cinder-dbcc4513-9e2c-4a80-9cd0-9feed1113397-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Lock "cinder-dbcc4513-9e2c-4a80-9cd0-9feed1113397-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Created reservations ['ba70f6cd-f55d-4324-8929-f424ef8f3883', '14b98dab-3a9f-4a01-bca7-bf61c696510a', '765273f7-969a-4bbd-84b1-2a824bfcd10b', '7a7683cb-3a4c-46f6-a42d-b02650123f05'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Flow 'volume_create_manager' (1cbd2f44-4582-44e8-9f14-5b3059da5b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ce197a-764c-4e65-b7ee-a566072cb98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Acquiring lock "cinder-quobyte-dbcc4513-9e2c-4a80-9cd0-9feed1113397" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ce197a-764c-4e65-b7ee-a566072cb98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-198781391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d5c347-f8bf-455f-8d40-0166c19e89b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='741b5c86a9ca4b9b9b2b96407ba3c709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:40Z,use_quota=True,user_id='81ac2227c0b94506aab0f2ce698f694d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d29168d-6e5c-420d-b158-365602a9f105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d29168d-6e5c-420d-b158-365602a9f105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b02f404-fd91-4879-a542-63d8c8a33646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b02f404-fd91-4879-a542-63d8c8a33646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d5c347-f8bf-455f-8d40-0166c19e89b2', 'volume_name': 'volume-65d5c347-f8bf-455f-8d40-0166c19e89b2', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d501728-e48c-456c-a98b-30d027a7414f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d501728-e48c-456c-a98b-30d027a7414f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070fec7a-4237-4c5f-944e-0a10230e980d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:40 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Volume 65d5c347-f8bf-455f-8d40-0166c19e89b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d5c347-f8bf-455f-8d40-0166c19e89b2', 'volume_size': 1} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-198781391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d5c347-f8bf-455f-8d40-0166c19e89b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='741b5c86a9ca4b9b9b2b96407ba3c709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:40Z,use_quota=True,user_id='81ac2227c0b94506aab0f2ce698f694d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Creating volume 65d5c347-f8bf-455f-8d40-0166c19e89b2 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:09:40 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-65d5c347-f8bf-455f-8d40-0166c19e89b2 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Lock "cinder-quobyte-dbcc4513-9e2c-4a80-9cd0-9feed1113397" acquired by "delete_volume" :: waited 0.120s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:40 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-65d5c347-f8bf-455f-8d40-0166c19e89b2 1073741824 Jul 01 04:09:40 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Acquiring lock "cinder-4345223a-1952-49a5-96c5-28dc832c68cc-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc263938-cdfc-48e7-adcb-c2d9a33ec795]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Lock "cinder-4345223a-1952-49a5-96c5-28dc832c68cc-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:40 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:40 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:40 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:09:40 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Acquiring lock "cinder-quobyte-4345223a-1952-49a5-96c5-28dc832c68cc" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:41 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Lock "cinder-quobyte-4345223a-1952-49a5-96c5-28dc832c68cc" acquired by "delete_volume" :: waited 0.038s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:41 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc911ba-6179-4c98-9227-7ac16ccd70fc]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4345223a-1952-49a5-96c5-28dc832c68cc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:41 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4345223a-1952-49a5-96c5-28dc832c68cc Jul 01 04:09:41 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:42 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-65d5c347-f8bf-455f-8d40-0166c19e89b2 1073741824" returned: 0 in 1.601s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-65d5c347-f8bf-455f-8d40-0166c19e89b2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:42 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-65d5c347-f8bf-455f-8d40-0166c19e89b2 Jul 01 04:09:42 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:42 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397" returned: 0 in 1.574s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:42 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4345223a-1952-49a5-96c5-28dc832c68cc" returned: 0 in 1.217s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4345223a-1952-49a5-96c5-28dc832c68cc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:42 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397 Jul 01 04:09:42 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:42 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4345223a-1952-49a5-96c5-28dc832c68cc Jul 01 04:09:42 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:42 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.564s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:42 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:09:42 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Deleted volume successfully. Jul 01 04:09:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e99d665f-ac95-49df-a409-145a9e05d72f tempest-VolumesTestJSON-829016062 None] Lock "cinder-f5c25df4-ed03-426a-814e-f65c5490fea2-delete_volume" released by "delete_volume" :: held 4.367s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:43 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4345223a-1952-49a5-96c5-28dc832c68cc" returned: 0 in 0.854s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Lock "cinder-quobyte-4345223a-1952-49a5-96c5-28dc832c68cc" released by "delete_volume" :: held 2.153s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:43 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-65d5c347-f8bf-455f-8d40-0166c19e89b2" returned: 0 in 1.167s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] <== create_volume: return (2831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.834s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:43 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-dbcc4513-9e2c-4a80-9cd0-9feed1113397" returned: 0 in 1.041s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070fec7a-4237-4c5f-944e-0a10230e980d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d5c347-f8bf-455f-8d40-0166c19e89b2', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4be21f-5b8d-4a97-8926-a566a517eed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Lock "cinder-quobyte-dbcc4513-9e2c-4a80-9cd0-9feed1113397" released by "delete_volume" :: held 2.855s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Created reservations ['959a0252-320e-4eba-8d9a-748fbbce15b4', '5ef86336-17a5-43e2-b046-fb7ffd520d7d', '611163a2-4ed1-490d-94b3-35a9b10d851c', '4a455fc2-ec16-430f-b363-00123c38ff48'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:09:43 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Volume volume-65d5c347-f8bf-455f-8d40-0166c19e89b2 (65d5c347-f8bf-455f-8d40-0166c19e89b2): created successfully Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4be21f-5b8d-4a97-8926-a566a517eed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Flow 'volume_create_manager' (1cbd2f44-4582-44e8-9f14-5b3059da5b19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:43 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d313e625-77a6-4595-9147-c79be9a4b5df tempest-VolumesListTestJSON-306781893 None] Created volume successfully. Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Created reservations ['de17aae3-b7a2-4ee8-95b9-21df674e66c5', '6094fd3f-bdd8-494e-8bcc-481c866df250', 'ae68c484-bbee-42b2-bd01-42a58a3b178f', '2e4d066c-57d7-415b-bb45-58f54bddcf5e'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c5700d98-4425-4279-8d8d-3a3ca661a6b7 tempest-VolumesActionsTest-971335995 None] Acquiring lock "cinder-c23db0ad-6498-455b-a3f0-b705c32f09cd" by "attach_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:43 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:09:43 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c5700d98-4425-4279-8d8d-3a3ca661a6b7 tempest-VolumesActionsTest-971335995 None] Lock "cinder-c23db0ad-6498-455b-a3f0-b705c32f09cd" acquired by "attach_volume" :: waited 0.031s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:43 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:09:43 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:43 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c5700d98-4425-4279-8d8d-3a3ca661a6b7 tempest-VolumesActionsTest-971335995 None] Attaching volume c23db0ad-6498-455b-a3f0-b705c32f09cd to instance 40a0c239-65b8-48f7-9add-910e304b2618 at mountpoint /dev/vdb on host None. Jul 01 04:09:43 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c5700d98-4425-4279-8d8d-3a3ca661a6b7 tempest-VolumesActionsTest-971335995 None] Attach volume completed successfully. Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c5700d98-4425-4279-8d8d-3a3ca661a6b7 tempest-VolumesActionsTest-971335995 None] Lock "cinder-c23db0ad-6498-455b-a3f0-b705c32f09cd" released by "attach_volume" :: held 0.153s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Acquiring lock "cinder-5213484d-7e98-4ca6-8dbb-e0c42a5605c8-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Lock "cinder-5213484d-7e98-4ca6-8dbb-e0c42a5605c8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Acquiring lock "cinder-quobyte-5213484d-7e98-4ca6-8dbb-e0c42a5605c8" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Lock "cinder-quobyte-5213484d-7e98-4ca6-8dbb-e0c42a5605c8" acquired by "delete_volume" :: waited 0.029s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93be9d0-432e-4a21-a256-d3954cd6ec6e]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9104d90d-efae-4be8-8ebf-81d8d1fde475 tempest-VolumesActionsTest-971335995 None] Acquiring lock "cinder-c23db0ad-6498-455b-a3f0-b705c32f09cd-detach_volume" by "detach_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:44 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8 Jul 01 04:09:44 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9104d90d-efae-4be8-8ebf-81d8d1fde475 tempest-VolumesActionsTest-971335995 None] Lock "cinder-c23db0ad-6498-455b-a3f0-b705c32f09cd-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:44 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-9104d90d-efae-4be8-8ebf-81d8d1fde475 tempest-VolumesActionsTest-971335995 None] Detaching volume c23db0ad-6498-455b-a3f0-b705c32f09cd from instance 40a0c239-65b8-48f7-9add-910e304b2618. Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Acquiring lock "cinder-4e34daab-80df-4e75-8a71-c693c0b00533-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Lock "cinder-4e34daab-80df-4e75-8a71-c693c0b00533-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:44 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-9104d90d-efae-4be8-8ebf-81d8d1fde475 tempest-VolumesActionsTest-971335995 None] Detach volume completed successfully. Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Acquiring lock "cinder-quobyte-4e34daab-80df-4e75-8a71-c693c0b00533" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9104d90d-efae-4be8-8ebf-81d8d1fde475 tempest-VolumesActionsTest-971335995 None] Lock "cinder-c23db0ad-6498-455b-a3f0-b705c32f09cd-detach_volume" released by "detach_volume" :: held 0.195s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Lock "cinder-quobyte-4e34daab-80df-4e75-8a71-c693c0b00533" acquired by "delete_volume" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46986b2-9596-49ea-b7da-0c08b658ac77]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4e34daab-80df-4e75-8a71-c693c0b00533 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:44 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4e34daab-80df-4e75-8a71-c693c0b00533 Jul 01 04:09:44 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:44 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:44 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.370s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.450s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:44 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:09:44 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Deleted volume successfully. Jul 01 04:09:45 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Deleted volume successfully. Jul 01 04:09:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d6df083d-3221-441e-b978-d9ab97bd4040 tempest-VolumesTestJSON-829016062 None] Lock "cinder-4345223a-1952-49a5-96c5-28dc832c68cc-delete_volume" released by "delete_volume" :: held 4.275s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d157c0b7-1dc8-44d1-9ea8-2cae0ebd05f1 tempest-VolumeDependencyTests-207662490 None] Lock "cinder-dbcc4513-9e2c-4a80-9cd0-9feed1113397-delete_volume" released by "delete_volume" :: held 4.812s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:45 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8" returned: 0 in 1.625s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:45 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8 Jul 01 04:09:45 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:45 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4e34daab-80df-4e75-8a71-c693c0b00533" returned: 0 in 1.348s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4e34daab-80df-4e75-8a71-c693c0b00533 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:45 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4e34daab-80df-4e75-8a71-c693c0b00533 Jul 01 04:09:45 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:46 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5213484d-7e98-4ca6-8dbb-e0c42a5605c8" returned: 0 in 0.999s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Lock "cinder-quobyte-5213484d-7e98-4ca6-8dbb-e0c42a5605c8" released by "delete_volume" :: held 2.679s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:46 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Created reservations ['8ac5f609-f5fb-449e-bb17-da567f86a77e', '38cba7e6-392b-41e6-ad62-031c68f9b6e5', 'f1e91b65-0616-48b6-bc8d-f934a3c3154b', 'eb54e822-0a04-437c-b724-64b98d21fde6'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:09:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:46 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:09:46 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:47 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-4e34daab-80df-4e75-8a71-c693c0b00533" returned: 0 in 1.185s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:47 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Lock "cinder-quobyte-4e34daab-80df-4e75-8a71-c693c0b00533" released by "delete_volume" :: held 2.630s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:47 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Created reservations ['1b1fbd0e-1c61-4542-83d4-9b90a39f335e', '6bdafb7d-a94a-45b5-9f80-d8813cee1ed2', 'a60e8093-c4f5-4b27-9844-871abeb91b63', '08c40397-a6c9-4d32-bd21-999d512e3e6c'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:09:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:47 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:09:47 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:47 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.012s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:47 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:09:47 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Deleted volume successfully. Jul 01 04:09:47 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-2e7f3be2-ad98-4ea3-a3e4-256880e093ef tempest-VolumeDependencyTests-207662490 None] Lock "cinder-5213484d-7e98-4ca6-8dbb-e0c42a5605c8-delete_volume" released by "delete_volume" :: held 4.056s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Acquiring lock "cinder-65d5c347-f8bf-455f-8d40-0166c19e89b2-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:48 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.991s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:48 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:09:48 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Deleted volume successfully. Jul 01 04:09:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Lock "cinder-65d5c347-f8bf-455f-8d40-0166c19e89b2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3fcb89ea-7add-422a-82d9-2f9c6a357dd3 tempest-VolumesTestJSON-829016062 None] Lock "cinder-4e34daab-80df-4e75-8a71-c693c0b00533-delete_volume" released by "delete_volume" :: held 4.030s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Acquiring lock "cinder-quobyte-65d5c347-f8bf-455f-8d40-0166c19e89b2" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Lock "cinder-quobyte-65d5c347-f8bf-455f-8d40-0166c19e89b2" acquired by "delete_volume" :: waited 0.034s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:48 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c74bee-df64-431d-aaf7-067a7385c1eb]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-65d5c347-f8bf-455f-8d40-0166c19e89b2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:48 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-65d5c347-f8bf-455f-8d40-0166c19e89b2 Jul 01 04:09:48 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-65d5c347-f8bf-455f-8d40-0166c19e89b2" returned: 0 in 0.961s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:49 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-65d5c347-f8bf-455f-8d40-0166c19e89b2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:49 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-65d5c347-f8bf-455f-8d40-0166c19e89b2 Jul 01 04:09:49 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:50 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-65d5c347-f8bf-455f-8d40-0166c19e89b2" returned: 0 in 0.865s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Lock "cinder-quobyte-65d5c347-f8bf-455f-8d40-0166c19e89b2" released by "delete_volume" :: held 1.878s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:50 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Created reservations ['dcb6ed8e-7e50-412f-9bdf-c80c353d46b9', '7c5c5ef7-2ccb-4315-b2bb-f2ff19deecab', '1bdc228c-3c8c-4764-ad3d-b69f99e1ea29', 'f930c35f-f876-47fc-9899-97d4e7c5a8b8'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:09:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:50 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:09:50 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Acquiring lock "cinder-ac16b173-c86e-4a5c-8460-2f146fd4d7d1-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Lock "cinder-ac16b173-c86e-4a5c-8460-2f146fd4d7d1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Acquiring lock "cinder-quobyte-ac16b173-c86e-4a5c-8460-2f146fd4d7d1" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Lock "cinder-quobyte-ac16b173-c86e-4a5c-8460-2f146fd4d7d1" acquired by "delete_volume" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:50 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[611a3abf-5256-42a7-8de3-fbedc8d91324]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:50 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1 Jul 01 04:09:50 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:51 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.770s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:51 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:09:51 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Deleted volume successfully. Jul 01 04:09:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b74acbd-7c4d-4f7c-9121-c2f6b95530fe tempest-VolumesListTestJSON-306781893 None] Lock "cinder-65d5c347-f8bf-455f-8d40-0166c19e89b2-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:51 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1" returned: 0 in 0.837s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:51 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1 Jul 01 04:09:51 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:52 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ac16b173-c86e-4a5c-8460-2f146fd4d7d1" returned: 0 in 0.672s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Lock "cinder-quobyte-ac16b173-c86e-4a5c-8460-2f146fd4d7d1" released by "delete_volume" :: held 1.572s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:52 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Created reservations ['7744ffe2-be64-4d89-bb7c-5c730a606134', '393246f2-381c-45f0-bfdf-4805c3bc3f80', 'e93a1b67-7ca5-4619-8162-44dc06e9ffa1', 'cc2e66a2-072c-4f6d-a383-7d862e0c9bb3'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:09:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:52 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:09:52 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:52 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-626a790b-1ff1-46a0-bc3f-40dbeff06829 tempest-GroupsV314Test-319227749 None] Group tempest-GroupsV314Test-Group-388158764: creating Jul 01 04:09:52 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-626a790b-1ff1-46a0-bc3f-40dbeff06829 tempest-GroupsV314Test-319227749 None] Group tempest-GroupsV314Test-Group-388158764: created successfully Jul 01 04:09:52 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-626a790b-1ff1-46a0-bc3f-40dbeff06829 tempest-GroupsV314Test-319227749 None] Create group completed successfully. Jul 01 04:09:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Acquiring lock "cinder-87d7ba9d-fddd-46dc-8749-b71638bb2dd6-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Lock "cinder-87d7ba9d-fddd-46dc-8749-b71638bb2dd6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Acquiring lock "cinder-quobyte-87d7ba9d-fddd-46dc-8749-b71638bb2dd6" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:09:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Lock "cinder-quobyte-87d7ba9d-fddd-46dc-8749-b71638bb2dd6" acquired by "delete_volume" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:09:53 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6190e2e-37c5-4b93-b47d-bdbcc3c3371f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:53 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.728s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:53 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:09:53 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Deleted volume successfully. Jul 01 04:09:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-82497186-f375-46a7-948c-17da717baae7 tempest-VolumesListTestJSON-306781893 None] Lock "cinder-ac16b173-c86e-4a5c-8460-2f146fd4d7d1-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:53 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6 Jul 01 04:09:53 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:53 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6" returned: 0 in 0.799s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:54 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6 Jul 01 04:09:54 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Flow 'volume_create_manager' (68a3de8c-f0ae-4711-b114-f29524c0fdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d290f08-3dbf-4c5d-8bbc-1880534df47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d290f08-3dbf-4c5d-8bbc-1880534df47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-197600057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cdbd150e-0c1a-4d5d-ac86-ec2c1aaafce2,host='devstack@QuobyteHD#QuobyteHD',id=06198f67-af0f-41a4-9c76-5cee40645733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d2a7d64008419b986d24928ce11e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:54Z,use_quota=True,user_id='8c7c4069f3924ab097bf872bc96a1ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b19813a2-0cf4-4e2d-858f-175eb13b4838),volume_type_id=b19813a2-0cf4-4e2d-858f-175eb13b4838)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936754e3-bf30-4a35-9022-ade79d870b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936754e3-bf30-4a35-9022-ade79d870b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301ac019-e16c-405e-8380-e58dc5f8e9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301ac019-e16c-405e-8380-e58dc5f8e9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06198f67-af0f-41a4-9c76-5cee40645733', 'volume_name': 'volume-06198f67-af0f-41a4-9c76-5cee40645733', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2f5b3a-1d49-4ca0-aaa6-181521c2b793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2f5b3a-1d49-4ca0-aaa6-181521c2b793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea3568e-8835-4ba8-88dc-d8f9d572a13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:54 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Volume 06198f67-af0f-41a4-9c76-5cee40645733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06198f67-af0f-41a4-9c76-5cee40645733', 'volume_size': 1} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cdbd150e-0c1a-4d5d-ac86-ec2c1aaafce2,created_at=2026-07-01T02:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-197600057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cdbd150e-0c1a-4d5d-ac86-ec2c1aaafce2,host='devstack@QuobyteHD#QuobyteHD',id=06198f67-af0f-41a4-9c76-5cee40645733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d2a7d64008419b986d24928ce11e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:09:54Z,use_quota=True,user_id='8c7c4069f3924ab097bf872bc96a1ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b19813a2-0cf4-4e2d-858f-175eb13b4838),volume_type_id=b19813a2-0cf4-4e2d-858f-175eb13b4838)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Creating volume 06198f67-af0f-41a4-9c76-5cee40645733 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:09:54 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:54 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 1073741824 Jul 01 04:09:54 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:54 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-87d7ba9d-fddd-46dc-8749-b71638bb2dd6" returned: 0 in 0.653s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Lock "cinder-quobyte-87d7ba9d-fddd-46dc-8749-b71638bb2dd6" released by "delete_volume" :: held 1.510s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Created reservations ['14b3bf6b-dc64-4709-bc06-f9d33cced295', 'efa15800-1ecf-4615-92fc-bf81fcc0b5d7', '9ae6ab11-7d9c-47f7-8cdd-52d94b644cda', '6c94c225-a294-43e3-96c1-8db478a12b0d'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:54 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:09:54 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:55 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 1073741824" returned: 0 in 0.877s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:55 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.679s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:55 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:09:55 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Deleted volume successfully. Jul 01 04:09:55 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 Jul 01 04:09:55 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-77976b2e-23ad-4dce-beda-cbe7a72e7870 tempest-VolumesListTestJSON-306781893 None] Lock "cinder-87d7ba9d-fddd-46dc-8749-b71638bb2dd6-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:09:56 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733" returned: 0 in 0.755s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:09:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:09:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea3568e-8835-4ba8-88dc-d8f9d572a13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06198f67-af0f-41a4-9c76-5cee40645733', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13959619-6e00-4cfa-ac70-e7e260d00033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:09:56 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Volume volume-06198f67-af0f-41a4-9c76-5cee40645733 (06198f67-af0f-41a4-9c76-5cee40645733): created successfully Jul 01 04:09:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13959619-6e00-4cfa-ac70-e7e260d00033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:09:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Flow 'volume_create_manager' (68a3de8c-f0ae-4711-b114-f29524c0fdb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:09:56 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0cbee289-850b-4980-b76c-b4e35eda2680 tempest-GroupsV314Test-319227749 None] Created volume successfully. Jul 01 04:09:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:09:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:09:58 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Cloning volume 06198f67-af0f-41a4-9c76-5cee40645733 to volume 6520ac8c-6e1f-4d88-b369-cfb8a83672e9 Jul 01 04:09:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Creating offline snapshot 33287c05-4744-4970-af13-e3a32696a4ff of volume 06198f67-af0f-41a4-9c76-5cee40645733 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:09:58 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4929ca-e0aa-4d9d-b5a3-fa9f2af33449]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:09:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:58 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 Jul 01 04:09:58 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:09:59 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Jul 01 04:09:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733" returned: 0 in 0.970s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:09:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:09:59 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff 1G Jul 01 04:09:59 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:00 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff 1G" returned: 0 in 1.109s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06198f67-af0f-41a4-9c76-5cee40645733 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:00 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06198f67-af0f-41a4-9c76-5cee40645733 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff Jul 01 04:10:00 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:01 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06198f67-af0f-41a4-9c76-5cee40645733 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff" returned: 0 in 0.979s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:01 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff is being set with open permissions: ugo+rw: NotImplementedError Jul 01 04:10:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:01 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff Jul 01 04:10:01 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:01 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff" returned: 0 in 0.730s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:01 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.info Jul 01 04:10:01 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:02 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.info" returned: 0 in 0.738s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:02 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.info is being set with open permissions: ugo+rw: NotImplementedError Jul 01 04:10:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:02 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.info Jul 01 04:10:02 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:03 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.info" returned: 0 in 0.862s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:03 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Acquiring lock "cinder-quobyte-6520ac8c-6e1f-4d88-b369-cfb8a83672e9" by "_copy_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:10:03 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Lock "cinder-quobyte-6520ac8c-6e1f-4d88-b369-cfb8a83672e9" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:10:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] snapshot: 33287c05-4744-4970-af13-e3a32696a4ff, volume: 6520ac8c-6e1f-4d88-b369-cfb8a83672e9, {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 04:10:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:10:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:10:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:10:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:10:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:10:03 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71e8699-c819-4c26-9b50-d8f83465c1c6]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:10:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:03 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff Jul 01 04:10:03 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:04 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff" returned: 0 in 0.816s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:04 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06198f67-af0f-41a4-9c76-5cee40645733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:10:04 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 04:10:04 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Creating direct copy from snapshot {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 04:10:04 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af91e32-2185-4f68-91dd-790ac309d5b0]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:10:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:04 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 Jul 01 04:10:04 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:05 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733" returned: 0 in 0.792s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:05 devstack cinder-volume[86177]: DEBUG cinder.utils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Path /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6520ac8c-6e1f-4d88-b369-cfb8a83672e9 not found in is_blk_device check {{(pid=86177) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 04:10:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6520ac8c-6e1f-4d88-b369-cfb8a83672e9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:05 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6520ac8c-6e1f-4d88-b369-cfb8a83672e9 Jul 01 04:10:05 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1e82da43-ae15-493d-aa45-ac6416f90b48 tempest-VolumesActionsTest-971335995 None] Acquiring lock "cinder-c23db0ad-6498-455b-a3f0-b705c32f09cd" by "attach_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:10:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1e82da43-ae15-493d-aa45-ac6416f90b48 tempest-VolumesActionsTest-971335995 None] Lock "cinder-c23db0ad-6498-455b-a3f0-b705c32f09cd" acquired by "attach_volume" :: waited 0.024s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:10:11 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1e82da43-ae15-493d-aa45-ac6416f90b48 tempest-VolumesActionsTest-971335995 None] Attaching volume c23db0ad-6498-455b-a3f0-b705c32f09cd to instance e6b984d7-7b72-492e-afb0-f808f3f4f626 at mountpoint /dev/vdb on host None. Jul 01 04:10:11 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1e82da43-ae15-493d-aa45-ac6416f90b48 tempest-VolumesActionsTest-971335995 None] Attach volume completed successfully. Jul 01 04:10:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1e82da43-ae15-493d-aa45-ac6416f90b48 tempest-VolumesActionsTest-971335995 None] Lock "cinder-c23db0ad-6498-455b-a3f0-b705c32f09cd" released by "attach_volume" :: held 0.434s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:10:12 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f040622f-0270-4b05-84dd-5510489a605a tempest-VolumesActionsTest-971335995 None] Acquiring lock "cinder-c23db0ad-6498-455b-a3f0-b705c32f09cd-detach_volume" by "detach_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:10:12 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f040622f-0270-4b05-84dd-5510489a605a tempest-VolumesActionsTest-971335995 None] Lock "cinder-c23db0ad-6498-455b-a3f0-b705c32f09cd-detach_volume" acquired by "detach_volume" :: waited 0.093s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:10:12 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f040622f-0270-4b05-84dd-5510489a605a tempest-VolumesActionsTest-971335995 None] Detaching volume c23db0ad-6498-455b-a3f0-b705c32f09cd from instance e6b984d7-7b72-492e-afb0-f808f3f4f626. Jul 01 04:10:12 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f040622f-0270-4b05-84dd-5510489a605a tempest-VolumesActionsTest-971335995 None] Detach volume completed successfully. Jul 01 04:10:12 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f040622f-0270-4b05-84dd-5510489a605a tempest-VolumesActionsTest-971335995 None] Lock "cinder-c23db0ad-6498-455b-a3f0-b705c32f09cd-detach_volume" released by "detach_volume" :: held 0.278s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:10:14 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6520ac8c-6e1f-4d88-b369-cfb8a83672e9" returned: 0 in 8.791s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:14 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2a0fcb-dd70-4e68-965a-59e3f68fb8d2]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:10:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:14 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 Jul 01 04:10:14 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:15 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733" returned: 0 in 1.420s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:15 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Image conversion details: src /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733, size 1024.00 MB, duration 8.79 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6520ac8c-6e1f-4d88-b369-cfb8a83672e9 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:10:15 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Converted 1024.00 MB image at 116.45 MB/s Jul 01 04:10:15 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6520ac8c-6e1f-4d88-b369-cfb8a83672e9 is being set with open permissions: ugo+rw: NotImplementedError Jul 01 04:10:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6520ac8c-6e1f-4d88-b369-cfb8a83672e9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:15 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6520ac8c-6e1f-4d88-b369-cfb8a83672e9 Jul 01 04:10:15 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:16 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6520ac8c-6e1f-4d88-b369-cfb8a83672e9" returned: 0 in 0.735s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Lock "cinder-quobyte-6520ac8c-6e1f-4d88-b369-cfb8a83672e9" released by "_copy_volume_from_snapshot" :: held 12.676s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Acquiring lock "cinder-quobyte-33287c05-4744-4970-af13-e3a32696a4ff" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Lock "cinder-quobyte-33287c05-4744-4970-af13-e3a32696a4ff" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Deleting offline snapshot 33287c05-4744-4970-af13-e3a32696a4ff of volume 06198f67-af0f-41a4-9c76-5cee40645733 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] snapshot_file for this snap is: volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50ea72d-3d9e-4464-8aa6-981a2dd66f40]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Flow 'volume_create_manager' (98f2289a-9894-4b7c-9edf-b5a9c5c72d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ef1e83-67dc-46a9-9e93-1aea69b58805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:16 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff Jul 01 04:10:16 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ef1e83-67dc-46a9-9e93-1aea69b58805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1942735458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ff97b8c-7342-4b71-acd2-e23b1abf1b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24edbda41c6045248b7e48f3ff93b9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:10:16Z,use_quota=True,user_id='db6d2eda9c6f46a2af926397ee46976a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618430e8-4656-4cea-ad74-f6b27a0427e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618430e8-4656-4cea-ad74-f6b27a0427e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31a538c-4d6b-4e83-9e63-48b95784a79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31a538c-4d6b-4e83-9e63-48b95784a79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ff97b8c-7342-4b71-acd2-e23b1abf1b1f', 'volume_name': 'volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7e9e1d-0a49-4bd1-b035-a430f48921a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7e9e1d-0a49-4bd1-b035-a430f48921a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858daa0e-7858-4f59-9267-fb914cfc3f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:16 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Volume 2ff97b8c-7342-4b71-acd2-e23b1abf1b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f', 'volume_size': 1} Jul 01 04:10:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:10:17 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff" returned: 0 in 0.804s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06198f67-af0f-41a4-9c76-5cee40645733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:10:17 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[65180eed-0c1c-4cac-b451-8bfd0ffa9e14]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:10:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:17 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 Jul 01 04:10:17 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:17 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733" returned: 0 in 0.789s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:17 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff Jul 01 04:10:17 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:18 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff" returned: 0 in 0.753s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:18 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff Jul 01 04:10:18 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:19 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733.33287c05-4744-4970-af13-e3a32696a4ff" returned: 0 in 0.654s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Lock "cinder-quobyte-33287c05-4744-4970-af13-e3a32696a4ff" released by "_delete_snapshot" :: held 3.104s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:10:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.418s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:10:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.893s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:10:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1942735458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ff97b8c-7342-4b71-acd2-e23b1abf1b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24edbda41c6045248b7e48f3ff93b9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:10:16Z,use_quota=True,user_id='db6d2eda9c6f46a2af926397ee46976a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:10:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Creating volume 2ff97b8c-7342-4b71-acd2-e23b1abf1b1f {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:10:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:10:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:10:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:10:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:10:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:10:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:10:19 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:10:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:19 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f 1073741824 Jul 01 04:10:19 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:19 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f2ba4365-be4d-406e-8eeb-86ffad25967f tempest-GroupsV314Test-319227749 None] Create group from source-group-cdbd150e-0c1a-4d5d-ac86-ec2c1aaafce2 completed successfully. Jul 01 04:10:20 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f 1073741824" returned: 0 in 1.003s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Acquiring lock "cinder-quobyte-6520ac8c-6e1f-4d88-b369-cfb8a83672e9" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:10:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Lock "cinder-quobyte-6520ac8c-6e1f-4d88-b369-cfb8a83672e9" acquired by "delete_volume" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:10:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:20 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[5987134c-90f7-42cd-b37e-e5fe37fe1ff5]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:10:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6520ac8c-6e1f-4d88-b369-cfb8a83672e9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:20 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f Jul 01 04:10:20 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:20 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6520ac8c-6e1f-4d88-b369-cfb8a83672e9 Jul 01 04:10:20 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:21 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f" returned: 0 in 0.671s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:10:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:10:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858daa0e-7858-4f59-9267-fb914cfc3f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35779ed-a614-4541-83de-113455027931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:21 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Volume volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f (2ff97b8c-7342-4b71-acd2-e23b1abf1b1f): created successfully Jul 01 04:10:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35779ed-a614-4541-83de-113455027931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Flow 'volume_create_manager' (98f2289a-9894-4b7c-9edf-b5a9c5c72d4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:10:21 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c46efd4c-ea95-41f8-8430-1016f4e20bee tempest-VolumesSnapshotTestJSON-504995779 None] Created volume successfully. Jul 01 04:10:21 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6520ac8c-6e1f-4d88-b369-cfb8a83672e9" returned: 0 in 0.791s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6520ac8c-6e1f-4d88-b369-cfb8a83672e9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:21 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6520ac8c-6e1f-4d88-b369-cfb8a83672e9 Jul 01 04:10:21 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:21 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6520ac8c-6e1f-4d88-b369-cfb8a83672e9" returned: 0 in 0.696s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Lock "cinder-quobyte-6520ac8c-6e1f-4d88-b369-cfb8a83672e9" released by "delete_volume" :: held 1.555s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] Creating offline snapshot 28275411-7b5e-4788-ada7-19bbbcf9020f of volume 2ff97b8c-7342-4b71-acd2-e23b1abf1b1f {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8538e079-5c59-4fed-b1da-cddc1de5f9cc]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Created reservations ['915273fa-2bc0-4595-8ece-230b1a7c0729'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:10:22 devstack cinder-volume[86177]: WARNING cinder.quota [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1145097653 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1145097653, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:10:22 devstack cinder-volume[86177]: WARNING cinder.quota [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1145097653 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1145097653, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Created reservations ['bbf2afb8-0f88-4099-ad46-24c3664bf46b', '01d56137-aced-47ee-9862-c327a1cc93cd', '07dc4680-b1fe-4889-9414-10639476c867', 'c8911991-193d-4c27-a985-c5a13963ba4c'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:10:22 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f Jul 01 04:10:22 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:22 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:10:22 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:22 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f" returned: 0 in 0.887s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:23 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.691s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:23 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:10:23 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f 1G Jul 01 04:10:23 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8640d148-fc9f-4459-8c5d-373a0e235cce tempest-GroupsV314Test-319227749 None] Delete group completed successfully. Jul 01 04:10:23 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] Acquiring lock "cinder-quobyte-06198f67-af0f-41a4-9c76-5cee40645733" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:10:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] Lock "cinder-quobyte-06198f67-af0f-41a4-9c76-5cee40645733" acquired by "delete_volume" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:10:23 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da15bda-641e-40f6-b6e4-f5a3c4a85d0b]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:10:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:23 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 Jul 01 04:10:23 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:10:23 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f 1G" returned: 0 in 0.837s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:23 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f Jul 01 04:10:23 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:24 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733" returned: 0 in 0.833s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:24 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733 Jul 01 04:10:24 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:24 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:10:24 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:24 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f" returned: 0 in 0.729s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:24 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f is being set with open permissions: ugo+rw Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:24 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f Jul 01 04:10:24 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:24 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-06198f67-af0f-41a4-9c76-5cee40645733" returned: 0 in 0.668s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] Lock "cinder-quobyte-06198f67-af0f-41a4-9c76-5cee40645733" released by "delete_volume" :: held 1.565s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] Created reservations ['63297ec4-773a-494f-8544-d301ff715112'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] Created reservations ['d961cbbc-8568-4102-8d77-4623f7a1d267', 'ac727129-373b-4807-8974-64918002e1b5', '46dcec11-52e8-420e-b304-3102dcb780ac', 'a2bfe8ec-d6e9-49c0-8d9c-2ad125bb37f0'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:10:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:24 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:10:24 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:25 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.690s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:10:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:10:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:10:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:10:25 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f" returned: 0 in 0.664s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:25 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.info Jul 01 04:10:25 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:25 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.654s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:10:25 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-5a17e0e5-5894-4851-b3d8-af12e54839af tempest-GroupsV314Test-319227749 None] Delete group completed successfully. Jul 01 04:10:25 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.info" returned: 0 in 0.685s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:25 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.info is being set with open permissions: ugo+rw Jul 01 04:10:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:25 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.info Jul 01 04:10:25 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:26 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.info" returned: 0 in 0.696s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.604s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:10:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.349s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:10:26 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[57513a91-0b29-4074-9fe0-1cf802d218d1]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:10:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:26 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-e84f3d6c-5f90-4bfa-a0e9-c89f1b3c4f47 tempest-VolumesSnapshotTestJSON-504995779 None] Create snapshot completed successfully Jul 01 04:10:26 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd Jul 01 04:10:26 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-28275411-7b5e-4788-ada7-19bbbcf9020f-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:10:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-28275411-7b5e-4788-ada7-19bbbcf9020f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:10:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-quobyte-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:10:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:10:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-quobyte-28275411-7b5e-4788-ada7-19bbbcf9020f" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:10:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-28275411-7b5e-4788-ada7-19bbbcf9020f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:10:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Deleting offline snapshot 28275411-7b5e-4788-ada7-19bbbcf9020f of volume 2ff97b8c-7342-4b71-acd2-e23b1abf1b1f {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:10:27 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] snapshot_file for this snap is: volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:10:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd" returned: 0 in 0.917s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:27 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f45302-964c-4c8f-b017-1d14e3349cc8]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:10:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:27 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[940e48e5-daa9-4381-ba80-38aeb215fc0c]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:10:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:27 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f Jul 01 04:10:27 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:27 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd Jul 01 04:10:27 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:28 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd" returned: 0 in 0.817s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.f1905dc7-89bd-4517-9414-14c5075d9132rkmk997_.img {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:28 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f" returned: 0 in 0.849s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:10:28 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.f1905dc7-89bd-4517-9414-14c5075d9132rkmk997_.img Jul 01 04:10:28 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:28 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[760edf37-9287-47a7-b3cd-f491be14982e]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:10:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:28 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f Jul 01 04:10:28 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:29 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f" returned: 0 in 1.195s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:29 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f Jul 01 04:10:29 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:31 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f" returned: 0 in 1.475s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:31 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f Jul 01 04:10:31 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:32 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:10:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Flow 'volume_create_manager' (f90925ac-a00f-47f3-a777-29834bfd6a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:10:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c00e86-aaf4-42c8-b9da-46aeafff93bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c00e86-aaf4-42c8-b9da-46aeafff93bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1039453278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f47dc2d-92e7-42bf-9a47-59936efc1618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee569d99926492ea5764bb92d7a8122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:10:32Z,use_quota=True,user_id='0e43674deaed401189748cd43a3542c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba24aee-77d3-4388-9871-137ce2caf01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba24aee-77d3-4388-9871-137ce2caf01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1fcfa3-883b-4498-ba19-9ff8e804b58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1fcfa3-883b-4498-ba19-9ff8e804b58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f47dc2d-92e7-42bf-9a47-59936efc1618', 'volume_name': 'volume-3f47dc2d-92e7-42bf-9a47-59936efc1618', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b64eef-dbf0-4505-ad82-21a4a31762cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b64eef-dbf0-4505-ad82-21a4a31762cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06181dd5-893a-4ff5-b293-1e5a1be4ecb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:32 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Volume 3f47dc2d-92e7-42bf-9a47-59936efc1618: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f47dc2d-92e7-42bf-9a47-59936efc1618', 'volume_size': 1} Jul 01 04:10:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:10:33 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f.28275411-7b5e-4788-ada7-19bbbcf9020f" returned: 0 in 1.943s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:33 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-28275411-7b5e-4788-ada7-19bbbcf9020f" released by "_delete_snapshot" :: held 5.641s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:10:33 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f" released by "delete_snapshot" :: held 5.671s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:10:33 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Created reservations ['6e19e2cb-1699-4bda-b7c3-eb8e8e2c3da7', '781ccce4-dbf6-4996-9da7-9f3fa7825b6e', '5af3e224-47ea-4aa6-9941-da93b98dffb8', 'd93ac30c-f2a7-4bf0-9e81-f512ab8bbb6d'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:10:33 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Delete snapshot completed successfully. Jul 01 04:10:33 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e59c4ed8-a83d-4104-becd-7cc89affd0ba tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-28275411-7b5e-4788-ada7-19bbbcf9020f-delete_snapshot" released by "delete_snapshot" :: held 6.055s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:10:33 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.f1905dc7-89bd-4517-9414-14c5075d9132rkmk997_.img" returned: 0 in 5.412s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:33 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fb966e-cbf0-4c3e-a5f4-d4fc2039eb34]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:10:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:34 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd Jul 01 04:10:34 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:34 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:10:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Flow 'volume_create_manager' (2a1f1737-b3ab-4ed4-92a4-0f2b13780a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:10:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51504ff-cf13-4615-b159-2201771c8dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51504ff-cf13-4615-b159-2201771c8dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-979570182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8330880-c411-4ff1-aae6-f641476eaa67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24edbda41c6045248b7e48f3ff93b9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:10:34Z,use_quota=True,user_id='db6d2eda9c6f46a2af926397ee46976a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480ef25a-9fdc-4157-b434-604ebd588058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480ef25a-9fdc-4157-b434-604ebd588058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bb8734-e751-418c-9711-b2ad237b126f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bb8734-e751-418c-9711-b2ad237b126f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8330880-c411-4ff1-aae6-f641476eaa67', 'volume_name': 'volume-f8330880-c411-4ff1-aae6-f641476eaa67', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90860fa-68d3-425c-bc63-34a4bbfad500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90860fa-68d3-425c-bc63-34a4bbfad500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424a6182-2643-4cbd-9e0f-f569e0911e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:34 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Volume f8330880-c411-4ff1-aae6-f641476eaa67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8330880-c411-4ff1-aae6-f641476eaa67', 'volume_size': 1} Jul 01 04:10:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:10:34 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd" returned: 0 in 0.989s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:34 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] Image conversion details: src /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.f1905dc7-89bd-4517-9414-14c5075d9132rkmk997_.img {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:10:34 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] Converted 1024.00 MB image at 189.19 MB/s Jul 01 04:10:34 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] f1905dc7-89bd-4517-9414-14c5075d9132 was raw, no need to convert to raw {{(pid=86177) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 01 04:10:44 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=113,cinder:INSERT=32,cinder:UPDATE=104,cinder:DELETE=8 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:10:44 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=100,cinder:INSERT=28,cinder:UPDATE=133,cinder:DELETE=4 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:10:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.893s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:10:53 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] Uploaded volume to glance image-id: f1905dc7-89bd-4517-9414-14c5075d9132. {{(pid=86177) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 01 04:10:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.878s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:10:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1039453278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f47dc2d-92e7-42bf-9a47-59936efc1618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee569d99926492ea5764bb92d7a8122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:10:32Z,use_quota=True,user_id='0e43674deaed401189748cd43a3542c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:10:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Creating volume 3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:10:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:10:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:10:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:10:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:10:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:10:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:10:53 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:10:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:53 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 1073741824 Jul 01 04:10:53 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:53 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f3d8c425-7335-40a2-9a97-c8d6b165b655 tempest-VolumesActionsTest-971335995 None] Copy volume to image completed successfully. Jul 01 04:10:54 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 1073741824" returned: 0 in 0.826s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:54 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 Jul 01 04:10:54 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:55 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618" returned: 0 in 0.672s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.532s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-979570182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8330880-c411-4ff1-aae6-f641476eaa67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24edbda41c6045248b7e48f3ff93b9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:10:34Z,use_quota=True,user_id='db6d2eda9c6f46a2af926397ee46976a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Creating volume f8330880-c411-4ff1-aae6-f641476eaa67 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:10:55 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06181dd5-893a-4ff5-b293-1e5a1be4ecb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f47dc2d-92e7-42bf-9a47-59936efc1618', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:55 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 1073741824 Jul 01 04:10:55 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866d0e2e-ad42-4db4-be4a-ced209a5466c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:55 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Volume volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 (3f47dc2d-92e7-42bf-9a47-59936efc1618): created successfully Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866d0e2e-ad42-4db4-be4a-ced209a5466c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Flow 'volume_create_manager' (f90925ac-a00f-47f3-a777-29834bfd6a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:10:55 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-7c70f892-8916-461e-9653-c08ba078e865 tempest-SnapshotsActionsTest-2047829610 None] Created volume successfully. Jul 01 04:10:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:10:56 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 1073741824" returned: 0 in 0.878s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:56 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 Jul 01 04:10:56 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:10:56 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67" returned: 0 in 0.649s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:10:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:10:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.186s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:10:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424a6182-2643-4cbd-9e0f-f569e0911e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8330880-c411-4ff1-aae6-f641476eaa67', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14f5c16-f90c-402d-9da4-a76d62cfa53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:10:56 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd91c6a-22bd-4956-8ccf-0968cd4ac56f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:10:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:56 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Volume volume-f8330880-c411-4ff1-aae6-f641476eaa67 (f8330880-c411-4ff1-aae6-f641476eaa67): created successfully Jul 01 04:10:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14f5c16-f90c-402d-9da4-a76d62cfa53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:10:56 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Flow 'volume_create_manager' (2a1f1737-b3ab-4ed4-92a4-0f2b13780a79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:10:56 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f4846770-dde8-4228-b00c-ee73e3f3884b tempest-VolumesSnapshotTestJSON-504995779 None] Created volume successfully. Jul 01 04:10:56 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd Jul 01 04:10:56 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:10:57 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd" returned: 0 in 0.744s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:57 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f63fb7-6641-4723-870e-e61c0b94147b]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:10:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:57 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd Jul 01 04:10:57 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:10:58 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jul 01 04:10:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd" returned: 0 in 0.747s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:10:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.811e73c2-ba86-4724-a5ac-3c0651ea78609ol377rd.img {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:10:58 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.811e73c2-ba86-4724-a5ac-3c0651ea78609ol377rd.img Jul 01 04:10:58 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:02 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.811e73c2-ba86-4724-a5ac-3c0651ea78609ol377rd.img" returned: 0 in 4.520s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:02 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b049f0-36e9-4a54-ac22-28a20357c810]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:02 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd Jul 01 04:11:02 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:03 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd" returned: 0 in 0.895s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:03 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Image conversion details: src /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd, size 1024.00 MB, duration 4.52 sec, destination /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.811e73c2-ba86-4724-a5ac-3c0651ea78609ol377rd.img {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:11:03 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Converted 1024.00 MB image at 226.49 MB/s Jul 01 04:11:03 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] 811e73c2-ba86-4724-a5ac-3c0651ea7860 was raw, converting to qcow2 {{(pid=86177) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 01 04:11:03 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0a5bee-3bab-41a0-87d0-6d52801a9964]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.811e73c2-ba86-4724-a5ac-3c0651ea78609ol377rd.img {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:03 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.811e73c2-ba86-4724-a5ac-3c0651ea78609ol377rd.img Jul 01 04:11:03 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:04 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.811e73c2-ba86-4724-a5ac-3c0651ea78609ol377rd.img" returned: 0 in 0.704s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.811e73c2-ba86-4724-a5ac-3c0651ea78609ol377rd.img {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:04 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.811e73c2-ba86-4724-a5ac-3c0651ea78609ol377rd.img Jul 01 04:11:04 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:05 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.811e73c2-ba86-4724-a5ac-3c0651ea78609ol377rd.img" returned: 1 in 0.717s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.811e73c2-ba86-4724-a5ac-3c0651ea78609ol377rd.img' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:11:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.811e73c2-ba86-4724-a5ac-3c0651ea78609ol377rd.img /opt/stack/data/cinder/conversion/vol_upload_104js1mv {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:05 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.811e73c2-ba86-4724-a5ac-3c0651ea78609ol377rd.img /opt/stack/data/cinder/conversion/vol_upload_104js1mv Jul 01 04:11:05 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:05 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.811e73c2-ba86-4724-a5ac-3c0651ea78609ol377rd.img /opt/stack/data/cinder/conversion/vol_upload_104js1mv" returned: 0 in 0.643s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:05 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Image conversion details: src /opt/stack/data/cinder/conversion/c23db0ad-6498-455b-a3f0-b705c32f09cd.temp_image.811e73c2-ba86-4724-a5ac-3c0651ea78609ol377rd.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_104js1mv {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:11:05 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 01 04:11:05 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1035033e-c1e5-45ca-990b-411c17272579]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_104js1mv {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:05 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_104js1mv Jul 01 04:11:05 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:06 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_104js1mv" returned: 0 in 0.694s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.958s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:07 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Uploaded volume to glance image-id: 811e73c2-ba86-4724-a5ac-3c0651ea7860. {{(pid=86177) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 01 04:11:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.461s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:07 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] Creating offline snapshot b309c55a-f3d5-45e1-a637-aba093018098 of volume 3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:11:07 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eab447-a4b3-4b98-969a-f4e15775418b]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:07 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 Jul 01 04:11:07 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:08 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c16c5fc8-6375-4d87-b737-57cea6c25d8e tempest-VolumesActionsTest-971335995 None] Copy volume to image completed successfully. Jul 01 04:11:08 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618" returned: 0 in 0.798s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:08 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 1G Jul 01 04:11:08 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:09 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 1G" returned: 0 in 0.843s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:09 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 Jul 01 04:11:09 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Acquiring lock "cinder-c23db0ad-6498-455b-a3f0-b705c32f09cd-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Lock "cinder-c23db0ad-6498-455b-a3f0-b705c32f09cd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Acquiring lock "cinder-quobyte-c23db0ad-6498-455b-a3f0-b705c32f09cd" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Lock "cinder-quobyte-c23db0ad-6498-455b-a3f0-b705c32f09cd" acquired by "delete_volume" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:09 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a875d91f-deaa-44b3-9eca-52abf181140b]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:09 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd Jul 01 04:11:09 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:10 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098" returned: 0 in 0.729s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:10 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 is being set with open permissions: ugo+rw Jul 01 04:11:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:10 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 Jul 01 04:11:10 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:10 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd" returned: 0 in 0.742s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:10 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd Jul 01 04:11:10 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:10 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098" returned: 0 in 0.641s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:10 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.info Jul 01 04:11:10 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:11 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c23db0ad-6498-455b-a3f0-b705c32f09cd" returned: 0 in 0.662s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Lock "cinder-quobyte-c23db0ad-6498-455b-a3f0-b705c32f09cd" released by "delete_volume" :: held 1.442s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:11 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Created reservations ['998d4a1b-239b-4189-9cd9-5c42d68213b8', 'a0131f4d-2de0-432e-8a90-c4b4ed167c9b', '2cb6da16-ba5b-400e-b003-866723d86eb7', '7dfcf041-3396-45db-836a-2ef4bec00561'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:11:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:11:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:11:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:11 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:11:11 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:11 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.info" returned: 0 in 0.689s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:11 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.info is being set with open permissions: ugo+rw Jul 01 04:11:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:11 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.info Jul 01 04:11:11 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:12 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.671s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:12 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:11:12 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Deleted volume successfully. Jul 01 04:11:12 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d767ab0a-b2ba-48ab-a5d1-75fb2b3cbecb tempest-VolumesActionsTest-971335995 None] Lock "cinder-c23db0ad-6498-455b-a3f0-b705c32f09cd-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:12 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.info" returned: 0 in 0.650s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.452s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.078s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] Creating offline snapshot 8092a74b-34f8-45e7-9c88-854a9d5d7b97 of volume f8330880-c411-4ff1-aae6-f641476eaa67 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:11:12 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-963dd1fa-f73f-452e-8e55-6e99bf224b45 tempest-SnapshotsActionsTest-2047829610 None] Create snapshot completed successfully Jul 01 04:11:12 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[94db7131-829b-4882-8dab-49fca6a983b9]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:12 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 Jul 01 04:11:12 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:12 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67" returned: 0 in 0.791s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:12 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 1G Jul 01 04:11:12 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-91a0c691-1e42-4214-8a60-0ddab7ba11cb tempest-SnapshotsActionsTest-2047829610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:13 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 1G" returned: 0 in 0.888s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8330880-c411-4ff1-aae6-f641476eaa67 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:13 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8330880-c411-4ff1-aae6-f641476eaa67 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 Jul 01 04:11:13 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:14 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8330880-c411-4ff1-aae6-f641476eaa67 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97" returned: 0 in 0.736s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:14 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 is being set with open permissions: ugo+rw Jul 01 04:11:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:14 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 Jul 01 04:11:14 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:15 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97" returned: 0 in 0.738s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:15 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.info Jul 01 04:11:15 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:16 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.info" returned: 0 in 0.684s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:16 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.info is being set with open permissions: ugo+rw Jul 01 04:11:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:16 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.info Jul 01 04:11:16 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:16 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.info" returned: 0 in 0.659s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.600s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-91a0c691-1e42-4214-8a60-0ddab7ba11cb tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.142s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-91a0c691-1e42-4214-8a60-0ddab7ba11cb tempest-SnapshotsActionsTest-2047829610 None] Creating offline snapshot ddf31e4f-b51c-4cbe-9971-333861fd4e38 of volume 3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:11:16 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-b6563dd2-38c7-41b5-a5ca-2c908691a383 tempest-VolumesSnapshotTestJSON-504995779 None] Create snapshot completed successfully Jul 01 04:11:16 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81a0c67-5830-4daf-a469-2fded1544f8a]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-91a0c691-1e42-4214-8a60-0ddab7ba11cb tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:16 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 Jul 01 04:11:16 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:17 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:11:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Flow 'volume_create_manager' (ad9d245a-1704-44c7-858a-fdc1acff0a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:11:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0670805-7fb7-4b02-bae4-1c9ab9393e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0670805-7fb7-4b02-bae4-1c9ab9393e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1213590141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe994112-5fe3-4fe6-a7f5-3d3814121df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24edbda41c6045248b7e48f3ff93b9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:11:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8092a74b-34f8-45e7-9c88-854a9d5d7b97,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:11:17Z,use_quota=True,user_id='db6d2eda9c6f46a2af926397ee46976a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf512ec-6c57-47ba-a88f-3219580ede73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf512ec-6c57-47ba-a88f-3219580ede73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2062b4-67c7-497e-8658-29a9f55878f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2062b4-67c7-497e-8658-29a9f55878f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fe994112-5fe3-4fe6-a7f5-3d3814121df9', 'volume_name': 'volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9', 'volume_size': 2, 'snapshot_id': '8092a74b-34f8-45e7-9c88-854a9d5d7b97'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d2081d-117d-4ec0-bf92-491227ad0965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d2081d-117d-4ec0-bf92-491227ad0965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04ae464-cdc0-4914-a6ad-1483b26b6b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:17 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Volume fe994112-5fe3-4fe6-a7f5-3d3814121df9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9', 'volume_size': 2, 'snapshot_id': '8092a74b-34f8-45e7-9c88-854a9d5d7b97'} Jul 01 04:11:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:17 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-91a0c691-1e42-4214-8a60-0ddab7ba11cb tempest-SnapshotsActionsTest-2047829610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098" returned: 0 in 0.861s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-91a0c691-1e42-4214-8a60-0ddab7ba11cb tempest-SnapshotsActionsTest-2047829610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f47dc2d-92e7-42bf-9a47-59936efc1618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:11:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-91a0c691-1e42-4214-8a60-0ddab7ba11cb tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:17 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38 1G Jul 01 04:11:17 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:18 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:11:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Flow 'volume_create_manager' (594b1e58-b52f-42b0-b438-c49652ad4664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:11:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b27017-6a64-470d-9368-7cf570ac570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b27017-6a64-470d-9368-7cf570ac570d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-829917461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f85584-df28-443a-96ce-ff913aa1bb3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cff9819e4aa4f9cb1888d2475aa6bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:11:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:11:18Z,use_quota=True,user_id='e7d5cfb6b6de4cbc9c3b669525a89d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f635c9af-85ea-4541-abce-cf1d5d53011c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f635c9af-85ea-4541-abce-cf1d5d53011c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600e82a6-0bf6-4e44-af9a-7ea1bd835fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600e82a6-0bf6-4e44-af9a-7ea1bd835fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71f85584-df28-443a-96ce-ff913aa1bb3a', 'volume_name': 'volume-71f85584-df28-443a-96ce-ff913aa1bb3a', 'volume_size': 2}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f621c03-2feb-4387-a149-c63d4b31263f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f621c03-2feb-4387-a149-c63d4b31263f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8928edfe-2165-438a-9097-bb5b13104f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:18 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Volume 71f85584-df28-443a-96ce-ff913aa1bb3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71f85584-df28-443a-96ce-ff913aa1bb3a', 'volume_size': 2} Jul 01 04:11:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:18 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-91a0c691-1e42-4214-8a60-0ddab7ba11cb tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38 1G" returned: 0 in 0.850s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-91a0c691-1e42-4214-8a60-0ddab7ba11cb tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:18 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38 Jul 01 04:11:18 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:19 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-91a0c691-1e42-4214-8a60-0ddab7ba11cb tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38" returned: 0 in 0.700s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:19 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-91a0c691-1e42-4214-8a60-0ddab7ba11cb tempest-SnapshotsActionsTest-2047829610 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38 is being set with open permissions: ugo+rw Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-91a0c691-1e42-4214-8a60-0ddab7ba11cb tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:19 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38 Jul 01 04:11:19 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:19 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-91a0c691-1e42-4214-8a60-0ddab7ba11cb tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38" returned: 0 in 0.645s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-91a0c691-1e42-4214-8a60-0ddab7ba11cb tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.163s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.304s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-quobyte-8092a74b-34f8-45e7-9c88-854a9d5d7b97-fe994112-5fe3-4fe6-a7f5-3d3814121df9" by "_create_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-8092a74b-34f8-45e7-9c88-854a9d5d7b97-fe994112-5fe3-4fe6-a7f5-3d3814121df9" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Creating volume fe994112-5fe3-4fe6-a7f5-3d3814121df9 from snapshot 8092a74b-34f8-45e7-9c88-854a9d5d7b97 {{(pid=86177) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-quobyte-fe994112-5fe3-4fe6-a7f5-3d3814121df9" by "_copy_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:19 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-91a0c691-1e42-4214-8a60-0ddab7ba11cb tempest-SnapshotsActionsTest-2047829610 None] Create snapshot completed successfully Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-fe994112-5fe3-4fe6-a7f5-3d3814121df9" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] snapshot: 8092a74b-34f8-45e7-9c88-854a9d5d7b97, volume: fe994112-5fe3-4fe6-a7f5-3d3814121df9, {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d747753-e06e-493d-8b82-9a95ec91aac6]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:20 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 Jul 01 04:11:20 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:20 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97" returned: 0 in 0.736s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8330880-c411-4ff1-aae6-f641476eaa67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:11:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 04:11:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Creating direct copy from snapshot {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 04:11:20 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03047c7-f956-49f9-bcc5-b9bff7f683e1]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:20 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 Jul 01 04:11:20 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Acquiring lock "cinder-ddf31e4f-b51c-4cbe-9971-333861fd4e38-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-ddf31e4f-b51c-4cbe-9971-333861fd4e38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Acquiring lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Acquiring lock "cinder-quobyte-ddf31e4f-b51c-4cbe-9971-333861fd4e38" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-ddf31e4f-b51c-4cbe-9971-333861fd4e38" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Deleting offline snapshot ddf31e4f-b51c-4cbe-9971-333861fd4e38 of volume 3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:11:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] snapshot_file for this snap is: volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:11:21 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7ebb50-9c51-4e6f-b4dc-614fce025fae]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:21 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38 Jul 01 04:11:21 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:21 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67" returned: 0 in 0.780s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:21 devstack cinder-volume[86177]: DEBUG cinder.utils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Path /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9 not found in is_blk_device check {{(pid=86177) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 04:11:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:21 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9 Jul 01 04:11:21 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:21 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38" returned: 0 in 0.771s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f47dc2d-92e7-42bf-9a47-59936efc1618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:11:21 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89a8a7c-e540-43a5-a702-bd0d02763dca]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:21 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 Jul 01 04:11:21 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:23 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098" returned: 0 in 1.213s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f47dc2d-92e7-42bf-9a47-59936efc1618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:11:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:23 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38 Jul 01 04:11:23 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:11:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:11:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:11:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:24 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:11:24 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:24 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38" returned: 0 in 1.732s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:24 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38 Jul 01 04:11:24 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:26 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.536s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:26 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:11:26 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:11:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:11:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:11:26 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.ddf31e4f-b51c-4cbe-9971-333861fd4e38" returned: 0 in 1.311s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-ddf31e4f-b51c-4cbe-9971-333861fd4e38" released by "_delete_snapshot" :: held 5.167s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" released by "delete_snapshot" :: held 5.202s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:26 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Created reservations ['cae0c791-38ea-4a3a-8fbe-525ec2033864', '2dcd8e18-5483-436c-ac34-0196a930efbe', 'cf44939c-3f32-4938-ac2c-6fde486e7f6b', 'c2d7f9fa-4929-4faa-96fb-e85ce6eda199'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:11:26 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Delete snapshot completed successfully. Jul 01 04:11:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bba3bfc7-b1c9-4ccb-a3b6-d7259eb65c6d tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-ddf31e4f-b51c-4cbe-9971-333861fd4e38-delete_snapshot" released by "delete_snapshot" :: held 5.519s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:26 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9" returned: 0 in 5.229s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:26 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[560369e0-df06-454b-a480-a729d1ecde3d]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:26 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 Jul 01 04:11:26 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:27 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67" returned: 0 in 0.965s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:27 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Image conversion details: src /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:11:27 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Converted 1024.00 MB image at 195.77 MB/s Jul 01 04:11:27 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9 is being set with open permissions: ugo+rw Jul 01 04:11:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:27 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9 Jul 01 04:11:27 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0b79b403-6b49-41a4-b916-cac89cedb6ff tempest-SnapshotsActionsTest-2047829610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:28 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9" returned: 0 in 0.637s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-fe994112-5fe3-4fe6-a7f5-3d3814121df9" released by "_copy_volume_from_snapshot" :: held 8.432s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-8092a74b-34f8-45e7-9c88-854a9d5d7b97-fe994112-5fe3-4fe6-a7f5-3d3814121df9" released by "_create_volume_from_snapshot" :: held 8.468s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.488s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.144s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-829917461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f85584-df28-443a-96ce-ff913aa1bb3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cff9819e4aa4f9cb1888d2475aa6bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:11:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:11:18Z,use_quota=True,user_id='e7d5cfb6b6de4cbc9c3b669525a89d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Creating volume 71f85584-df28-443a-96ce-ff913aa1bb3a {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:11:28 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-71f85584-df28-443a-96ce-ff913aa1bb3a 2147483648 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:28 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-71f85584-df28-443a-96ce-ff913aa1bb3a 2147483648 Jul 01 04:11:28 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04ae464-cdc0-4914-a6ad-1483b26b6b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9', 'volume_size': 2, 'snapshot_id': '8092a74b-34f8-45e7-9c88-854a9d5d7b97'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9631c5b4-0837-42e1-bd49-2c5128d673fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:28 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Volume volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9 (fe994112-5fe3-4fe6-a7f5-3d3814121df9): created successfully Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9631c5b4-0837-42e1-bd49-2c5128d673fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Flow 'volume_create_manager' (ad9d245a-1704-44c7-858a-fdc1acff0a49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:11:28 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-510aa4d4-706d-4a48-b8ef-bde270f254fa tempest-VolumesSnapshotTestJSON-504995779 None] Created volume successfully. Jul 01 04:11:29 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-71f85584-df28-443a-96ce-ff913aa1bb3a 2147483648" returned: 0 in 0.865s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-71f85584-df28-443a-96ce-ff913aa1bb3a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:29 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-71f85584-df28-443a-96ce-ff913aa1bb3a Jul 01 04:11:29 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-fe994112-5fe3-4fe6-a7f5-3d3814121df9-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-fe994112-5fe3-4fe6-a7f5-3d3814121df9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-quobyte-fe994112-5fe3-4fe6-a7f5-3d3814121df9" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-fe994112-5fe3-4fe6-a7f5-3d3814121df9" acquired by "delete_volume" :: waited 0.015s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:29 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c00106e-8bd6-4cdc-9566-8b84d19c7e32]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:29 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9 Jul 01 04:11:29 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:29 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-71f85584-df28-443a-96ce-ff913aa1bb3a" returned: 0 in 0.657s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:11:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0b79b403-6b49-41a4-b916-cac89cedb6ff tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.160s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8928edfe-2165-438a-9097-bb5b13104f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71f85584-df28-443a-96ce-ff913aa1bb3a', 'volume_size': 2}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9f9c12-19ba-44d5-866c-fb6124b1968e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-0b79b403-6b49-41a4-b916-cac89cedb6ff tempest-SnapshotsActionsTest-2047829610 None] Creating offline snapshot 7318b813-eb8a-485b-911d-1e7ffe44108d of volume 3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:11:30 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Volume volume-71f85584-df28-443a-96ce-ff913aa1bb3a (71f85584-df28-443a-96ce-ff913aa1bb3a): created successfully Jul 01 04:11:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9f9c12-19ba-44d5-866c-fb6124b1968e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Flow 'volume_create_manager' (594b1e58-b52f-42b0-b438-c49652ad4664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:11:30 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0b8831-e173-4067-840a-ae715b98dca3]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b79b403-6b49-41a4-b916-cac89cedb6ff tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:30 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-291c3bdc-9a7c-4eb9-b1d8-cbe6f1be3ff8 tempest-VolumesCloneNegativeTest-846781981 None] Created volume successfully. Jul 01 04:11:30 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 Jul 01 04:11:30 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:30 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9" returned: 0 in 0.778s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:30 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9 Jul 01 04:11:30 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:30 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b79b403-6b49-41a4-b916-cac89cedb6ff tempest-SnapshotsActionsTest-2047829610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098" returned: 0 in 0.787s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-0b79b403-6b49-41a4-b916-cac89cedb6ff tempest-SnapshotsActionsTest-2047829610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f47dc2d-92e7-42bf-9a47-59936efc1618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:11:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b79b403-6b49-41a4-b916-cac89cedb6ff tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:30 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d 1G Jul 01 04:11:30 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:31 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-fe994112-5fe3-4fe6-a7f5-3d3814121df9" returned: 0 in 0.665s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-fe994112-5fe3-4fe6-a7f5-3d3814121df9" released by "delete_volume" :: held 1.502s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Created reservations ['0ca189c1-8dfc-43a3-8aa6-65d64e4d4246', 'dd730226-ef2d-4019-b2c7-5946ff2471bb', '1350d5fa-77c3-41a7-8e10-6c9811e37b7d', 'c6c220ad-5df5-45ff-a6dd-ef7e09021c08'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Acquiring lock "cinder-71f85584-df28-443a-96ce-ff913aa1bb3a-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Lock "cinder-71f85584-df28-443a-96ce-ff913aa1bb3a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:31 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:11:31 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Acquiring lock "cinder-quobyte-71f85584-df28-443a-96ce-ff913aa1bb3a" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Lock "cinder-quobyte-71f85584-df28-443a-96ce-ff913aa1bb3a" acquired by "delete_volume" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4edfb7-ae94-4405-8609-45be36215938]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-71f85584-df28-443a-96ce-ff913aa1bb3a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:31 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-71f85584-df28-443a-96ce-ff913aa1bb3a Jul 01 04:11:31 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:31 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b79b403-6b49-41a4-b916-cac89cedb6ff tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d 1G" returned: 0 in 0.881s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b79b403-6b49-41a4-b916-cac89cedb6ff tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:31 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d Jul 01 04:11:31 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:31 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-8092a74b-34f8-45e7-9c88-854a9d5d7b97-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-8092a74b-34f8-45e7-9c88-854a9d5d7b97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-quobyte-f8330880-c411-4ff1-aae6-f641476eaa67" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-f8330880-c411-4ff1-aae6-f641476eaa67" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-quobyte-8092a74b-34f8-45e7-9c88-854a9d5d7b97" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-8092a74b-34f8-45e7-9c88-854a9d5d7b97" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Deleting offline snapshot 8092a74b-34f8-45e7-9c88-854a9d5d7b97 of volume f8330880-c411-4ff1-aae6-f641476eaa67 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] snapshot_file for this snap is: volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6871ae-4c89-4f6a-a089-686cc2ab091e]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:32 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.737s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:11:32 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Deleted volume successfully. Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d28e9710-1cea-47cb-b703-954789ce80a9 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-fe994112-5fe3-4fe6-a7f5-3d3814121df9-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:32 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 Jul 01 04:11:32 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:32 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-71f85584-df28-443a-96ce-ff913aa1bb3a" returned: 0 in 0.818s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-71f85584-df28-443a-96ce-ff913aa1bb3a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:32 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-71f85584-df28-443a-96ce-ff913aa1bb3a Jul 01 04:11:32 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:32 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b79b403-6b49-41a4-b916-cac89cedb6ff tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d" returned: 0 in 0.830s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:32 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-0b79b403-6b49-41a4-b916-cac89cedb6ff tempest-SnapshotsActionsTest-2047829610 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d is being set with open permissions: ugo+rw Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b79b403-6b49-41a4-b916-cac89cedb6ff tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:32 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d Jul 01 04:11:32 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:32 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97" returned: 0 in 0.815s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8330880-c411-4ff1-aae6-f641476eaa67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[92258bdb-a235-49ba-8f92-e5f09b660cdf]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:33 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-71f85584-df28-443a-96ce-ff913aa1bb3a" returned: 0 in 0.691s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Lock "cinder-quobyte-71f85584-df28-443a-96ce-ff913aa1bb3a" released by "delete_volume" :: held 1.554s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:33 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 Jul 01 04:11:33 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Created reservations ['19d33474-c993-436c-93df-3512da2588f3', '2a50faa3-7bae-4201-a32f-7d08b8a5cf3f', 'ae0420c5-dc4c-47dd-bd8b-08b4501c7384', '7306e789-71c8-45e7-82c6-a61d19229296'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:33 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:11:33 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:33 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b79b403-6b49-41a4-b916-cac89cedb6ff tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d" returned: 0 in 0.677s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0b79b403-6b49-41a4-b916-cac89cedb6ff tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.309s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:33 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0b79b403-6b49-41a4-b916-cac89cedb6ff tempest-SnapshotsActionsTest-2047829610 None] Create snapshot completed successfully Jul 01 04:11:33 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67" returned: 0 in 0.817s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:33 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 Jul 01 04:11:33 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:33 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.675s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:11:33 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Deleted volume successfully. Jul 01 04:11:33 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-490e569f-ede8-4976-8ffd-6f7c1fb9d2f9 tempest-VolumesCloneNegativeTest-846781981 None] Lock "cinder-71f85584-df28-443a-96ce-ff913aa1bb3a-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:34 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Acquiring lock "cinder-7318b813-eb8a-485b-911d-1e7ffe44108d-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:34 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-7318b813-eb8a-485b-911d-1e7ffe44108d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:34 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Acquiring lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:34 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:34 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Acquiring lock "cinder-quobyte-7318b813-eb8a-485b-911d-1e7ffe44108d" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:34 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-7318b813-eb8a-485b-911d-1e7ffe44108d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Deleting offline snapshot 7318b813-eb8a-485b-911d-1e7ffe44108d of volume 3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:11:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] snapshot_file for this snap is: volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:11:34 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b3de80-e19b-42ce-8dd1-ef9270c27b65]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:34 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d Jul 01 04:11:34 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:34 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97" returned: 0 in 0.867s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:34 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97 Jul 01 04:11:34 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:35 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d" returned: 0 in 0.880s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:35 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f47dc2d-92e7-42bf-9a47-59936efc1618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:11:35 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[888b772e-7aa1-434c-b3ea-ba6624184885]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:35 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 Jul 01 04:11:35 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:35 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67.8092a74b-34f8-45e7-9c88-854a9d5d7b97" returned: 0 in 0.761s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-8092a74b-34f8-45e7-9c88-854a9d5d7b97" released by "_delete_snapshot" :: held 3.377s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-f8330880-c411-4ff1-aae6-f641476eaa67" released by "delete_snapshot" :: held 3.404s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:35 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Created reservations ['6a284190-7dd4-428f-a374-a4a7161d278e', 'b7dcd24c-d240-4f32-b8c3-23d9f5db1ccb', 'cbcd0150-5bf5-4ca7-a4bc-b2153072d80e', 'd12bc107-25a1-4078-9d55-5c3a79e0cafe'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:11:35 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Delete snapshot completed successfully. Jul 01 04:11:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-122b9e65-8010-455d-94d1-ff1048f05543 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-8092a74b-34f8-45e7-9c88-854a9d5d7b97-delete_snapshot" released by "delete_snapshot" :: held 3.568s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:36 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098" returned: 0 in 0.818s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f47dc2d-92e7-42bf-9a47-59936efc1618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:11:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:36 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d Jul 01 04:11:36 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:36 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-f8330880-c411-4ff1-aae6-f641476eaa67-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:36 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-f8330880-c411-4ff1-aae6-f641476eaa67-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:36 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-quobyte-f8330880-c411-4ff1-aae6-f641476eaa67" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:36 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-f8330880-c411-4ff1-aae6-f641476eaa67" acquired by "delete_volume" :: waited 0.015s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:36 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e1c607-8e3b-46b7-a515-4749d6e69aae]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:36 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 Jul 01 04:11:36 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:36 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d" returned: 0 in 0.821s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:36 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d Jul 01 04:11:36 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:37 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67" returned: 0 in 0.867s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:37 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67 Jul 01 04:11:37 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:37 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.7318b813-eb8a-485b-911d-1e7ffe44108d" returned: 0 in 0.737s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:37 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-7318b813-eb8a-485b-911d-1e7ffe44108d" released by "_delete_snapshot" :: held 3.373s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:37 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" released by "delete_snapshot" :: held 3.401s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:37 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Created reservations ['23d288b4-c57c-41a1-95d7-7f3cb2f1cc47', '956cec31-e48d-4bf8-a117-1ab4480c6f31', 'dec3467c-80da-47ea-885d-8cdd621215d2', 'cbb4b238-1ce3-4ae5-9922-ee480aa18961'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:11:37 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Delete snapshot completed successfully. Jul 01 04:11:37 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b562477d-4c94-4982-9d4a-534f8c31a427 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-7318b813-eb8a-485b-911d-1e7ffe44108d-delete_snapshot" released by "delete_snapshot" :: held 3.556s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:38 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f8330880-c411-4ff1-aae6-f641476eaa67" returned: 0 in 0.711s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-f8330880-c411-4ff1-aae6-f641476eaa67" released by "delete_volume" :: held 1.645s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Created reservations ['dcec80dc-6d55-4e0b-854c-ca0c106e7460', 'd5381e94-6b08-4c82-9ccd-b22d6ff375a8', 'b9193481-2e6d-4573-84ea-6268c5b818a0', '88ab7b61-6046-4141-9f83-4b29130c9a37'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:38 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:11:38 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4e289482-182c-434e-bdb8-1931cc71c00e tempest-SnapshotsActionsTest-2047829610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4e289482-182c-434e-bdb8-1931cc71c00e tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-4e289482-182c-434e-bdb8-1931cc71c00e tempest-SnapshotsActionsTest-2047829610 None] Creating offline snapshot 73264b63-25b2-474e-bace-8ef13309edc9 of volume 3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:11:38 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.732s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:11:38 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Deleted volume successfully. Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[342531d1-5d87-480d-9f60-537ff122a1d2]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4e289482-182c-434e-bdb8-1931cc71c00e tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:38 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-665f2d5d-f408-4392-8119-f0f9f5bc167c tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-f8330880-c411-4ff1-aae6-f641476eaa67-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:39 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 Jul 01 04:11:39 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:39 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:11:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Flow 'volume_create_manager' (4b9d24eb-4e02-400d-8b5e-87bdda6f5fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:11:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c9b482a-bb11-468b-91b9-110416f83821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c9b482a-bb11-468b-91b9-110416f83821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-573779174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf704eb7-0ddd-4516-83af-a0c748ca7576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24edbda41c6045248b7e48f3ff93b9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:11:39Z,use_quota=True,user_id='db6d2eda9c6f46a2af926397ee46976a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f6e37c-6709-42c6-b443-5ba926433852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f6e37c-6709-42c6-b443-5ba926433852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd5bc78-cc3d-408b-9f73-56e2d9e8c8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd5bc78-cc3d-408b-9f73-56e2d9e8c8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf704eb7-0ddd-4516-83af-a0c748ca7576', 'volume_name': 'volume-cf704eb7-0ddd-4516-83af-a0c748ca7576', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef18bc6c-f385-40d1-9bcc-a228788a84a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef18bc6c-f385-40d1-9bcc-a228788a84a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:39 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66bb3a7-e8f7-4da8-89bb-b675d59cd972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:39 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Volume cf704eb7-0ddd-4516-83af-a0c748ca7576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf704eb7-0ddd-4516-83af-a0c748ca7576', 'volume_size': 1} Jul 01 04:11:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:39 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4e289482-182c-434e-bdb8-1931cc71c00e tempest-SnapshotsActionsTest-2047829610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098" returned: 0 in 0.898s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-4e289482-182c-434e-bdb8-1931cc71c00e tempest-SnapshotsActionsTest-2047829610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f47dc2d-92e7-42bf-9a47-59936efc1618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:11:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4e289482-182c-434e-bdb8-1931cc71c00e tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:39 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9 1G Jul 01 04:11:39 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:40 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4e289482-182c-434e-bdb8-1931cc71c00e tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9 1G" returned: 0 in 0.861s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4e289482-182c-434e-bdb8-1931cc71c00e tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:40 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9 Jul 01 04:11:40 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:41 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4e289482-182c-434e-bdb8-1931cc71c00e tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9" returned: 0 in 0.751s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:41 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-4e289482-182c-434e-bdb8-1931cc71c00e tempest-SnapshotsActionsTest-2047829610 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9 is being set with open permissions: ugo+rw Jul 01 04:11:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4e289482-182c-434e-bdb8-1931cc71c00e tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:41 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9 Jul 01 04:11:41 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:42 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4e289482-182c-434e-bdb8-1931cc71c00e tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9" returned: 0 in 0.666s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4e289482-182c-434e-bdb8-1931cc71c00e tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.348s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.817s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-573779174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf704eb7-0ddd-4516-83af-a0c748ca7576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24edbda41c6045248b7e48f3ff93b9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:11:39Z,use_quota=True,user_id='db6d2eda9c6f46a2af926397ee46976a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:11:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Creating volume cf704eb7-0ddd-4516-83af-a0c748ca7576 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:11:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:11:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:11:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:11:42 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:11:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:42 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 1073741824 Jul 01 04:11:42 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:42 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-4e289482-182c-434e-bdb8-1931cc71c00e tempest-SnapshotsActionsTest-2047829610 None] Create snapshot completed successfully Jul 01 04:11:43 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 1073741824" returned: 0 in 0.883s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:43 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 Jul 01 04:11:43 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Acquiring lock "cinder-73264b63-25b2-474e-bace-8ef13309edc9-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-73264b63-25b2-474e-bace-8ef13309edc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Acquiring lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Acquiring lock "cinder-quobyte-73264b63-25b2-474e-bace-8ef13309edc9" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-73264b63-25b2-474e-bace-8ef13309edc9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Deleting offline snapshot 73264b63-25b2-474e-bace-8ef13309edc9 of volume 3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:11:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] snapshot_file for this snap is: volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:11:43 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf7cf18-d725-458b-aabd-af5004b70d64]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:43 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9 Jul 01 04:11:43 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:44 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576" returned: 0 in 0.886s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66bb3a7-e8f7-4da8-89bb-b675d59cd972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf704eb7-0ddd-4516-83af-a0c748ca7576', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd6026c-ca70-4e0e-9ad7-3507432f0f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:44 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Volume volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 (cf704eb7-0ddd-4516-83af-a0c748ca7576): created successfully Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd6026c-ca70-4e0e-9ad7-3507432f0f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Flow 'volume_create_manager' (4b9d24eb-4e02-400d-8b5e-87bdda6f5fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:11:44 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-4e1fb23f-0142-4fe9-b51c-fa042de25e37 tempest-VolumesSnapshotTestJSON-504995779 None] Created volume successfully. Jul 01 04:11:44 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9" returned: 0 in 0.891s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f47dc2d-92e7-42bf-9a47-59936efc1618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6313d436-bc10-4b78-8f50-f9704f4b7c96]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:44 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 Jul 01 04:11:44 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=66,cinder:UPDATE=69,cinder:DELETE=8,cinder:INSERT=14 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] Creating offline snapshot a9155f37-a9d7-4f06-8206-3992c99f4974 of volume cf704eb7-0ddd-4516-83af-a0c748ca7576 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05c6d9e-6d78-4e59-b98e-598526ee8623]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:45 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 Jul 01 04:11:45 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:45 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098" returned: 0 in 1.018s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:45 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f47dc2d-92e7-42bf-9a47-59936efc1618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:11:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:45 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9 Jul 01 04:11:45 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:45 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576" returned: 0 in 0.971s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:45 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 1G Jul 01 04:11:45 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:46 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9" returned: 0 in 0.954s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:46 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9 Jul 01 04:11:46 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:46 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 1G" returned: 0 in 0.873s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:46 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 Jul 01 04:11:46 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:47 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.73264b63-25b2-474e-bace-8ef13309edc9" returned: 0 in 0.779s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:47 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-73264b63-25b2-474e-bace-8ef13309edc9" released by "_delete_snapshot" :: held 3.787s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:47 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" released by "delete_snapshot" :: held 3.815s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:47 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=70,cinder:INSERT=20,cinder:SELECT=58,cinder:DELETE=6 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:11:47 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Created reservations ['6f4bd828-b8f8-4f29-9a17-ead48a0c4bdd', '28cd2991-0010-4748-a8c4-8e80244099e5', '810d7187-57ee-4ca5-80ee-968d51aeccd0', '19e174ff-03ea-4be7-a8a9-78b99e927e6b'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:11:47 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Delete snapshot completed successfully. Jul 01 04:11:47 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8ba4559a-f034-4c00-ac1b-49f80e73cea0 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-73264b63-25b2-474e-bace-8ef13309edc9-delete_snapshot" released by "delete_snapshot" :: held 4.016s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:11:47 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974" returned: 0 in 0.743s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:47 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 is being set with open permissions: ugo+rw Jul 01 04:11:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:47 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 Jul 01 04:11:47 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a48e72a1-02fb-47e7-b8b6-4673ab09e226 tempest-SnapshotsActionsTest-2047829610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:48 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974" returned: 0 in 0.844s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:48 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.info Jul 01 04:11:48 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:49 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.info" returned: 0 in 0.724s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:49 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.info is being set with open permissions: ugo+rw Jul 01 04:11:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:49 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.info Jul 01 04:11:49 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:49 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.info" returned: 0 in 0.671s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.952s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a48e72a1-02fb-47e7-b8b6-4673ab09e226 tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.888s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-a48e72a1-02fb-47e7-b8b6-4673ab09e226 tempest-SnapshotsActionsTest-2047829610 None] Creating offline snapshot e11db9c2-52c5-4dcb-a0ab-797a33b2a71d of volume 3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:11:49 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-affdf170-3a4a-4156-a3f0-118c41e2600b tempest-VolumesSnapshotTestJSON-504995779 None] Create snapshot completed successfully Jul 01 04:11:49 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[da72ff57-cd54-4987-a454-7f86762b0932]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a48e72a1-02fb-47e7-b8b6-4673ab09e226 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:49 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 Jul 01 04:11:49 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:50 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:11:50 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a48e72a1-02fb-47e7-b8b6-4673ab09e226 tempest-SnapshotsActionsTest-2047829610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098" returned: 0 in 1.008s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-a48e72a1-02fb-47e7-b8b6-4673ab09e226 tempest-SnapshotsActionsTest-2047829610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f47dc2d-92e7-42bf-9a47-59936efc1618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:11:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a48e72a1-02fb-47e7-b8b6-4673ab09e226 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:50 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d 1G Jul 01 04:11:50 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Flow 'volume_create_manager' (9642bea8-870f-4379-a791-9d0967f83858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:11:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5095c8b1-73c8-48ec-90f3-3bbaf6ecbecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5095c8b1-73c8-48ec-90f3-3bbaf6ecbecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-562128325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa505c0-7420-4692-887d-941b16beb7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24edbda41c6045248b7e48f3ff93b9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a9155f37-a9d7-4f06-8206-3992c99f4974,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:11:51Z,use_quota=True,user_id='db6d2eda9c6f46a2af926397ee46976a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed9231e-0f9a-49ab-bfd6-b6da595eecad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed9231e-0f9a-49ab-bfd6-b6da595eecad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170adef7-4425-4274-919a-a481a3c98634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170adef7-4425-4274-919a-a481a3c98634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1aa505c0-7420-4692-887d-941b16beb7a7', 'volume_name': 'volume-1aa505c0-7420-4692-887d-941b16beb7a7', 'volume_size': 1, 'snapshot_id': 'a9155f37-a9d7-4f06-8206-3992c99f4974'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b3466e-58e2-470b-84b8-53c7cf102fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b3466e-58e2-470b-84b8-53c7cf102fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:11:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000c2373-836d-42be-bfbf-ca0de1e22634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:11:50 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Volume 1aa505c0-7420-4692-887d-941b16beb7a7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1aa505c0-7420-4692-887d-941b16beb7a7', 'volume_size': 1, 'snapshot_id': 'a9155f37-a9d7-4f06-8206-3992c99f4974'} Jul 01 04:11:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:51 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a48e72a1-02fb-47e7-b8b6-4673ab09e226 tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d 1G" returned: 0 in 0.951s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a48e72a1-02fb-47e7-b8b6-4673ab09e226 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:51 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d Jul 01 04:11:51 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:52 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a48e72a1-02fb-47e7-b8b6-4673ab09e226 tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d" returned: 0 in 0.742s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:52 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-a48e72a1-02fb-47e7-b8b6-4673ab09e226 tempest-SnapshotsActionsTest-2047829610 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d is being set with open permissions: ugo+rw Jul 01 04:11:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a48e72a1-02fb-47e7-b8b6-4673ab09e226 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:52 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d Jul 01 04:11:52 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:53 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a48e72a1-02fb-47e7-b8b6-4673ab09e226 tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d" returned: 0 in 0.727s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a48e72a1-02fb-47e7-b8b6-4673ab09e226 tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.541s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.328s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-quobyte-a9155f37-a9d7-4f06-8206-3992c99f4974-1aa505c0-7420-4692-887d-941b16beb7a7" by "_create_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-a9155f37-a9d7-4f06-8206-3992c99f4974-1aa505c0-7420-4692-887d-941b16beb7a7" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Creating volume 1aa505c0-7420-4692-887d-941b16beb7a7 from snapshot a9155f37-a9d7-4f06-8206-3992c99f4974 {{(pid=86177) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-quobyte-1aa505c0-7420-4692-887d-941b16beb7a7" by "_copy_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:53 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-a48e72a1-02fb-47e7-b8b6-4673ab09e226 tempest-SnapshotsActionsTest-2047829610 None] Create snapshot completed successfully Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-1aa505c0-7420-4692-887d-941b16beb7a7" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] snapshot: a9155f37-a9d7-4f06-8206-3992c99f4974, volume: 1aa505c0-7420-4692-887d-941b16beb7a7, {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72f33bb-16ef-4081-9a03-aaa124258f33]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:53 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 Jul 01 04:11:53 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Acquiring lock "cinder-e11db9c2-52c5-4dcb-a0ab-797a33b2a71d-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-e11db9c2-52c5-4dcb-a0ab-797a33b2a71d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Acquiring lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Acquiring lock "cinder-quobyte-e11db9c2-52c5-4dcb-a0ab-797a33b2a71d" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-e11db9c2-52c5-4dcb-a0ab-797a33b2a71d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Deleting offline snapshot e11db9c2-52c5-4dcb-a0ab-797a33b2a71d of volume 3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] snapshot_file for this snap is: volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5396a7-b6d5-48b1-8aa1-414e5ff98e7f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:54 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974" returned: 0 in 1.053s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf704eb7-0ddd-4516-83af-a0c748ca7576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Creating direct copy from snapshot {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[63aadc2e-b79d-4c88-aec9-a14a2d0f1c99]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:54 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d Jul 01 04:11:54 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:54 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 Jul 01 04:11:54 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:55 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d" returned: 0 in 0.985s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f47dc2d-92e7-42bf-9a47-59936efc1618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:11:55 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5a56c3-7c5a-476f-8078-d8956c3146b4]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:11:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:55 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576" returned: 0 in 0.950s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:55 devstack cinder-volume[86177]: DEBUG cinder.utils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Path /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1aa505c0-7420-4692-887d-941b16beb7a7 not found in is_blk_device check {{(pid=86177) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 04:11:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1aa505c0-7420-4692-887d-941b16beb7a7 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:55 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1aa505c0-7420-4692-887d-941b16beb7a7 Jul 01 04:11:55 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:55 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 Jul 01 04:11:55 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:56 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098" returned: 0 in 0.973s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f47dc2d-92e7-42bf-9a47-59936efc1618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:11:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:56 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d Jul 01 04:11:56 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:11:58 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Jul 01 04:11:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d" returned: 0 in 2.311s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:11:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:11:58 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d Jul 01 04:11:58 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:00 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.e11db9c2-52c5-4dcb-a0ab-797a33b2a71d" returned: 0 in 1.308s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-e11db9c2-52c5-4dcb-a0ab-797a33b2a71d" released by "_delete_snapshot" :: held 5.733s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" released by "delete_snapshot" :: held 5.765s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:00 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Created reservations ['ddc81ff3-7a04-46c9-a64c-13905e71fa9e', '63dbbc25-9cca-48ef-a33e-f48056f3b1f7', '9d39dd6c-3af4-461c-ae67-77df5965fb05', 'ef006d05-75f6-4cba-837e-1bd805491168'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:12:00 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Delete snapshot completed successfully. Jul 01 04:12:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-9707dcc1-f8ed-44d9-8724-c7e025d4fa65 tempest-SnapshotsActionsTest-426673270 None] Lock "cinder-e11db9c2-52c5-4dcb-a0ab-797a33b2a71d-delete_snapshot" released by "delete_snapshot" :: held 6.081s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Acquiring lock "cinder-b309c55a-f3d5-45e1-a637-aba093018098-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Lock "cinder-b309c55a-f3d5-45e1-a637-aba093018098-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Acquiring lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Acquiring lock "cinder-quobyte-b309c55a-f3d5-45e1-a637-aba093018098" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Lock "cinder-quobyte-b309c55a-f3d5-45e1-a637-aba093018098" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:01 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Deleting offline snapshot b309c55a-f3d5-45e1-a637-aba093018098 of volume 3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:12:01 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] snapshot_file for this snap is: volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:12:01 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4a826e-b952-470a-8e1d-96272d4f3ab1]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:01 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1aa505c0-7420-4692-887d-941b16beb7a7" returned: 0 in 6.447s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:01 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[72967203-c05e-43dd-9ced-304dbbc9977d]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:02 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 Jul 01 04:12:02 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:02 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 Jul 01 04:12:02 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:02 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098" returned: 0 in 0.958s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f47dc2d-92e7-42bf-9a47-59936efc1618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:12:02 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b9a4be-85a2-4205-9575-90f0b4cd99f6]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:03 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 Jul 01 04:12:03 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:03 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576" returned: 0 in 1.149s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Image conversion details: src /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1aa505c0-7420-4692-887d-941b16beb7a7 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:12:03 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Converted 1024.00 MB image at 158.76 MB/s Jul 01 04:12:03 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1aa505c0-7420-4692-887d-941b16beb7a7 is being set with open permissions: ugo+rw Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1aa505c0-7420-4692-887d-941b16beb7a7 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:03 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1aa505c0-7420-4692-887d-941b16beb7a7 Jul 01 04:12:03 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Flow 'volume_create_manager' (f713b567-ad05-4267-acaa-032f8fee80b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac11be5-bf0c-4185-9491-2d9b1fd46107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac11be5-bf0c-4185-9491-2d9b1fd46107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1387208485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8382d6-9aab-46a7-971a-522ed50e47d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d3ad1083914d75b6fa1428ece62443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:12:04Z,use_quota=True,user_id='7592f1f8790e42ac8860c070564e34f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec719c55-a81e-4d9f-b15b-69ef5b3be7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec719c55-a81e-4d9f-b15b-69ef5b3be7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47bc4f78-6281-41b4-a0d7-682b1757cd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47bc4f78-6281-41b4-a0d7-682b1757cd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d8382d6-9aab-46a7-971a-522ed50e47d5', 'volume_name': 'volume-1d8382d6-9aab-46a7-971a-522ed50e47d5', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3f209a-224b-4bc9-acd0-b0fc55ee8933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3f209a-224b-4bc9-acd0-b0fc55ee8933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea49c4c-4430-43ec-b12d-5a378a2772e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:03 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Volume 1d8382d6-9aab-46a7-971a-522ed50e47d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d8382d6-9aab-46a7-971a-522ed50e47d5', 'volume_size': 1} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:03 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618" returned: 0 in 0.926s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:03 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1aa505c0-7420-4692-887d-941b16beb7a7" returned: 0 in 0.756s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-1aa505c0-7420-4692-887d-941b16beb7a7" released by "_copy_volume_from_snapshot" :: held 10.490s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:03 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 Jul 01 04:12:03 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-a9155f37-a9d7-4f06-8206-3992c99f4974-1aa505c0-7420-4692-887d-941b16beb7a7" released by "_create_volume_from_snapshot" :: held 10.532s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.561s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.176s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1387208485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8382d6-9aab-46a7-971a-522ed50e47d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d3ad1083914d75b6fa1428ece62443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:12:04Z,use_quota=True,user_id='7592f1f8790e42ac8860c070564e34f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Creating volume 1d8382d6-9aab-46a7-971a-522ed50e47d5 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:12:03 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1d8382d6-9aab-46a7-971a-522ed50e47d5 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:03 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1d8382d6-9aab-46a7-971a-522ed50e47d5 1073741824 Jul 01 04:12:03 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:03 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Flow 'volume_create_manager' (0f4f7861-3294-43c7-a9c4-e3da9f632021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b47d126-b35e-4758-9e57-5bf1d683c073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000c2373-836d-42be-bfbf-ca0de1e22634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa505c0-7420-4692-887d-941b16beb7a7', 'volume_size': 1, 'snapshot_id': 'a9155f37-a9d7-4f06-8206-3992c99f4974'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b97273-0b37-4968-a040-c5a14fa260c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b47d126-b35e-4758-9e57-5bf1d683c073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-995268395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1af5a66-3670-42eb-a390-767e132dfec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d3ad1083914d75b6fa1428ece62443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:12:04Z,use_quota=True,user_id='7592f1f8790e42ac8860c070564e34f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c24ada-2212-49ed-a97e-8538ad0c7ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c24ada-2212-49ed-a97e-8538ad0c7ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a8896f-ced7-48c1-9358-f587cc0b4290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a8896f-ced7-48c1-9358-f587cc0b4290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1af5a66-3670-42eb-a390-767e132dfec6', 'volume_name': 'volume-f1af5a66-3670-42eb-a390-767e132dfec6', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c70670-78a0-4d64-81fe-9ba728d51c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c70670-78a0-4d64-81fe-9ba728d51c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a669e0-a438-48d5-a25a-d2a4b446608c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:04 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Volume f1af5a66-3670-42eb-a390-767e132dfec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1af5a66-3670-42eb-a390-767e132dfec6', 'volume_size': 1} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:04 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Volume volume-1aa505c0-7420-4692-887d-941b16beb7a7 (1aa505c0-7420-4692-887d-941b16beb7a7): created successfully Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b97273-0b37-4968-a040-c5a14fa260c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Flow 'volume_create_manager' (9642bea8-870f-4379-a791-9d0967f83858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:12:04 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-915ca725-c9f7-40dd-bbba-82a36fa79251 tempest-VolumesSnapshotTestJSON-504995779 None] Created volume successfully. Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-1aa505c0-7420-4692-887d-941b16beb7a7-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-1aa505c0-7420-4692-887d-941b16beb7a7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-quobyte-1aa505c0-7420-4692-887d-941b16beb7a7" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-1aa505c0-7420-4692-887d-941b16beb7a7" acquired by "delete_volume" :: waited 0.024s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d34427d-02a5-41b1-9d00-17999c935bc3]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1aa505c0-7420-4692-887d-941b16beb7a7 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:04 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098" returned: 0 in 0.971s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:04 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098 Jul 01 04:12:04 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:04 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1aa505c0-7420-4692-887d-941b16beb7a7 Jul 01 04:12:04 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:05 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1d8382d6-9aab-46a7-971a-522ed50e47d5 1073741824" returned: 0 in 1.186s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1d8382d6-9aab-46a7-971a-522ed50e47d5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:05 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1d8382d6-9aab-46a7-971a-522ed50e47d5 Jul 01 04:12:05 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:05 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618.b309c55a-f3d5-45e1-a637-aba093018098" returned: 0 in 0.761s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Lock "cinder-quobyte-b309c55a-f3d5-45e1-a637-aba093018098" released by "_delete_snapshot" :: held 3.762s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" released by "delete_snapshot" :: held 3.799s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:05 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1aa505c0-7420-4692-887d-941b16beb7a7" returned: 0 in 0.956s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1aa505c0-7420-4692-887d-941b16beb7a7 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Created reservations ['405711ba-576e-4c8b-b92f-4ec4a5461880', 'da7aa7e5-e2ec-4773-b3d2-634e4f56c8ba', '51b00ac9-db07-406b-a8a3-349a369f9cf2', '94da8589-6edb-4a4a-b8fb-24a64612f4d8'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:12:05 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1aa505c0-7420-4692-887d-941b16beb7a7 Jul 01 04:12:05 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:05 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Delete snapshot completed successfully. Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-139a37ef-2347-4b7f-9800-2bb2e6f25276 tempest-SnapshotsActionsTest-2047829610 None] Lock "cinder-b309c55a-f3d5-45e1-a637-aba093018098-delete_snapshot" released by "delete_snapshot" :: held 4.022s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:05 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1d8382d6-9aab-46a7-971a-522ed50e47d5" returned: 0 in 0.785s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.813s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-995268395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1af5a66-3670-42eb-a390-767e132dfec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d3ad1083914d75b6fa1428ece62443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:12:04Z,use_quota=True,user_id='7592f1f8790e42ac8860c070564e34f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Creating volume f1af5a66-3670-42eb-a390-767e132dfec6 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:12:05 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f1af5a66-3670-42eb-a390-767e132dfec6 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:05 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f1af5a66-3670-42eb-a390-767e132dfec6 1073741824 Jul 01 04:12:05 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea49c4c-4430-43ec-b12d-5a378a2772e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d8382d6-9aab-46a7-971a-522ed50e47d5', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:05 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4737d277-a705-4eb9-a07f-a49d697207b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:06 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Volume volume-1d8382d6-9aab-46a7-971a-522ed50e47d5 (1d8382d6-9aab-46a7-971a-522ed50e47d5): created successfully Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4737d277-a705-4eb9-a07f-a49d697207b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Flow 'volume_create_manager' (f713b567-ad05-4267-acaa-032f8fee80b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:12:06 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f20e2919-7767-4dec-a5eb-39ee3c0968ba tempest-TestServerVolumeAttachmentScenario-79102763 None] Created volume successfully. Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Acquiring lock "cinder-3f47dc2d-92e7-42bf-9a47-59936efc1618-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Lock "cinder-3f47dc2d-92e7-42bf-9a47-59936efc1618-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Acquiring lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" acquired by "delete_volume" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a248d2d-e4ef-453f-b6a2-7e8972e62541]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:06 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 Jul 01 04:12:06 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:06 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1aa505c0-7420-4692-887d-941b16beb7a7" returned: 0 in 0.932s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-1aa505c0-7420-4692-887d-941b16beb7a7" released by "delete_volume" :: held 1.940s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Created reservations ['8d7bb58a-efbe-4179-b985-30691c77845b', '835cc390-07fe-45dd-951a-9ee1e6c801f5', '713725a4-8c9c-4263-a1bd-457ed4da6dfb', '683237e8-8faa-4376-a598-4bab99a4e299'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:06 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:12:06 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:07 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f1af5a66-3670-42eb-a390-767e132dfec6 1073741824" returned: 0 in 1.078s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-a9155f37-a9d7-4f06-8206-3992c99f4974-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-a9155f37-a9d7-4f06-8206-3992c99f4974-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-quobyte-cf704eb7-0ddd-4516-83af-a0c748ca7576" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f1af5a66-3670-42eb-a390-767e132dfec6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-cf704eb7-0ddd-4516-83af-a0c748ca7576" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-quobyte-a9155f37-a9d7-4f06-8206-3992c99f4974" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:07 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f1af5a66-3670-42eb-a390-767e132dfec6 Jul 01 04:12:07 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-a9155f37-a9d7-4f06-8206-3992c99f4974" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Deleting offline snapshot a9155f37-a9d7-4f06-8206-3992c99f4974 of volume cf704eb7-0ddd-4516-83af-a0c748ca7576 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] snapshot_file for this snap is: volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7fcb69-5fc3-42e2-bccb-e7a71ab8352c]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:07 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 Jul 01 04:12:07 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:07 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618" returned: 0 in 1.101s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:07 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618 Jul 01 04:12:07 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:07 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.799s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:12:07 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Deleted volume successfully. Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-20cf868a-ac97-45df-99f1-560421162c62 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-1aa505c0-7420-4692-887d-941b16beb7a7-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:07 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f1af5a66-3670-42eb-a390-767e132dfec6" returned: 0 in 0.840s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a669e0-a438-48d5-a25a-d2a4b446608c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1af5a66-3670-42eb-a390-767e132dfec6', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:07 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d8042f-cb2d-41fa-8e98-e4ea229a2364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:08 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Volume volume-f1af5a66-3670-42eb-a390-767e132dfec6 (f1af5a66-3670-42eb-a390-767e132dfec6): created successfully Jul 01 04:12:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d8042f-cb2d-41fa-8e98-e4ea229a2364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Flow 'volume_create_manager' (0f4f7861-3294-43c7-a9c4-e3da9f632021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:12:08 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-17aa4c66-abc0-4b5a-8a08-9c98dd6a3230 tempest-TestServerVolumeAttachmentScenario-79102763 None] Created volume successfully. Jul 01 04:12:08 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974" returned: 0 in 1.091s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf704eb7-0ddd-4516-83af-a0c748ca7576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:12:08 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7263b5-b7e3-4d8a-bb5b-4a81543ee322]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:08 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 Jul 01 04:12:08 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:08 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3f47dc2d-92e7-42bf-9a47-59936efc1618" returned: 0 in 1.008s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:08 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Lock "cinder-quobyte-3f47dc2d-92e7-42bf-9a47-59936efc1618" released by "delete_volume" :: held 2.183s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:08 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Created reservations ['0877b2b2-2f13-42d1-a67d-cb55e99743b3', '9f627a3f-8e4d-427a-9bcf-4c9f6c21ffa9', 'eb4f13aa-d00a-4036-ab64-03cefb331aa1', 'deb3eaee-3b78-4977-be18-617447ebe34d'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:12:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:08 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:12:08 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:09 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576" returned: 0 in 0.843s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:09 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 Jul 01 04:12:09 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:09 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.699s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:09 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:12:09 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Deleted volume successfully. Jul 01 04:12:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d0b30ffc-0b31-4d34-9d5d-d29f5f3d6403 tempest-SnapshotsActionsTest-2047829610 None] Lock "cinder-3f47dc2d-92e7-42bf-9a47-59936efc1618-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:09 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974" returned: 0 in 0.803s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:10 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974 Jul 01 04:12:10 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:10 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576.a9155f37-a9d7-4f06-8206-3992c99f4974" returned: 0 in 0.726s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:10 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-a9155f37-a9d7-4f06-8206-3992c99f4974" released by "_delete_snapshot" :: held 3.594s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:10 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-cf704eb7-0ddd-4516-83af-a0c748ca7576" released by "delete_snapshot" :: held 3.628s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:10 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Created reservations ['9fa10399-d25f-442c-bf15-6164b90a587b', 'ace0f3dc-4f2a-4d61-b5c4-6186675e79c6', '8d4c1e77-f507-4d78-a491-844f40636707', 'e045e712-6316-45a8-b331-bbca93003f31'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:12:10 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Delete snapshot completed successfully. Jul 01 04:12:10 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4aadefda-7459-47ce-92fc-868426f039ba tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-a9155f37-a9d7-4f06-8206-3992c99f4974-delete_snapshot" released by "delete_snapshot" :: held 3.789s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-cf704eb7-0ddd-4516-83af-a0c748ca7576-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-cf704eb7-0ddd-4516-83af-a0c748ca7576-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-quobyte-cf704eb7-0ddd-4516-83af-a0c748ca7576" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-cf704eb7-0ddd-4516-83af-a0c748ca7576" acquired by "delete_volume" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:11 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55c1bf2-9378-431d-bcf0-56a7c3c15b27]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:11 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 Jul 01 04:12:11 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:12 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576" returned: 0 in 0.826s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:12 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576 Jul 01 04:12:12 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:13 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-cf704eb7-0ddd-4516-83af-a0c748ca7576" returned: 0 in 0.692s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-cf704eb7-0ddd-4516-83af-a0c748ca7576" released by "delete_volume" :: held 1.590s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Created reservations ['afc20a5b-91b5-4939-9dd4-e8c236fccf76', 'af3f7051-921a-4e94-ab15-faba7542c864', '41b4cf94-5799-4d35-af4a-93a490efba8e', '777deb28-2e92-4042-bdaa-508d3820f627'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:13 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:12:13 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "cinder-quobyte-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f" acquired by "delete_volume" :: waited 0.024s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:13 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.714s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:12:13 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Deleted volume successfully. Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9670931d-3b77-4574-891e-c1fbd143b3d3]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0b9b725d-5591-4769-a451-48ef475f05ea tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-cf704eb7-0ddd-4516-83af-a0c748ca7576-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:14 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f Jul 01 04:12:14 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:14 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f" returned: 0 in 0.789s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:14 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f Jul 01 04:12:14 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:15 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f" returned: 0 in 0.726s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:15 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-quobyte-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f" released by "delete_volume" :: held 1.614s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:15 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Created reservations ['05fd7554-11ca-455b-b6bf-ecef539688f9', '02533748-eda0-49f3-b0ca-06d0246a65d5', '60d03481-5734-44fb-899c-4a074e2d1ae7', '86a2982d-b68a-4b8f-a3c7-ed292123dc2c'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:12:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:15 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:12:15 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:16 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.850s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:16 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:12:16 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Deleted volume successfully. Jul 01 04:12:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-477c923a-b448-41a7-885d-ec3fa8424b48 tempest-VolumesSnapshotTestJSON-504995779 None] Lock "cinder-2ff97b8c-7342-4b71-acd2-e23b1abf1b1f-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:22 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:12:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Flow 'volume_create_manager' (3aa26608-b74f-4270-bef0-a87bef0f22eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:12:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb50105-ab2c-44ab-8dc5-209b18ad9f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb50105-ab2c-44ab-8dc5-209b18ad9f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1203215332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1071df-a2fe-4110-bce1-58ae6b24a9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8c3940b0634a7393e21ea90d8cfc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:12:23Z,use_quota=True,user_id='fc336b11d41f49fd845e85f94ce7a5e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebb2a4b-c882-4154-aa7d-13064401dd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebb2a4b-c882-4154-aa7d-13064401dd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0646df-2067-4a3a-a37e-78b34da29bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0646df-2067-4a3a-a37e-78b34da29bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea1071df-a2fe-4110-bce1-58ae6b24a9c6', 'volume_name': 'volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c27d775-8497-4b31-92c1-950cc71a83c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c27d775-8497-4b31-92c1-950cc71a83c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee37b82b-5c42-4265-a5f9-6686102676c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:23 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Volume ea1071df-a2fe-4110-bce1-58ae6b24a9c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6', 'volume_size': 1} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1203215332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1071df-a2fe-4110-bce1-58ae6b24a9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8c3940b0634a7393e21ea90d8cfc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:12:23Z,use_quota=True,user_id='fc336b11d41f49fd845e85f94ce7a5e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Creating volume ea1071df-a2fe-4110-bce1-58ae6b24a9c6 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:12:23 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:12:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:23 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 1073741824 Jul 01 04:12:23 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:12:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:24 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:12:24 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:24 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 1073741824" returned: 0 in 1.591s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:24 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 Jul 01 04:12:24 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:25 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.989s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:12:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:12:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:12:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:12:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" returned: 0 in 1.125s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] <== create_volume: return (2782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:12:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.788s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:25 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee37b82b-5c42-4265-a5f9-6686102676c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2521c55-46e6-4205-9e1a-5408f58c2a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:25 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Volume volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 (ea1071df-a2fe-4110-bce1-58ae6b24a9c6): created successfully Jul 01 04:12:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2521c55-46e6-4205-9e1a-5408f58c2a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Flow 'volume_create_manager' (3aa26608-b74f-4270-bef0-a87bef0f22eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:12:26 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-ad9cf91d-e2bd-421c-8ef2-03d2078eeb25 tempest-VolumesSnapshotListTestJSON-1471433645 None] Created volume successfully. Jul 01 04:12:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] Creating offline snapshot 8246c11c-4976-4fc8-904f-6e0228fc13cb of volume ea1071df-a2fe-4110-bce1-58ae6b24a9c6 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:12:26 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eb74f2-5f31-4ec9-8b96-25cecc49a228]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:26 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 Jul 01 04:12:26 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:27 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" returned: 0 in 1.046s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:27 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb 1G Jul 01 04:12:27 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:28 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb 1G" returned: 0 in 1.063s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:28 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb Jul 01 04:12:28 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:29 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:12:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Flow 'volume_create_manager' (90caa8d0-4f60-4c4d-b557-14256ab97708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:12:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99378aae-a3fc-46d7-94e8-79e3cbb31394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99378aae-a3fc-46d7-94e8-79e3cbb31394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1433496046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1703c579-72f6-43ea-8239-4413d5ab1021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadb54f88d0d467b87f81fc47dd57572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:12:29Z,use_quota=True,user_id='a387f0680e3844ebbb78d74566b7932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3491a5-25b0-48d6-bd12-32de3c96314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3491a5-25b0-48d6-bd12-32de3c96314b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eab5a36-6e76-4080-a17a-c2ed61b550b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eab5a36-6e76-4080-a17a-c2ed61b550b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1703c579-72f6-43ea-8239-4413d5ab1021', 'volume_name': 'volume-1703c579-72f6-43ea-8239-4413d5ab1021', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671d954a-03d4-4dcf-a47a-1009f704cd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671d954a-03d4-4dcf-a47a-1009f704cd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a3b1ee-83c5-4373-8400-1f5804eab9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:29 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Volume 1703c579-72f6-43ea-8239-4413d5ab1021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1703c579-72f6-43ea-8239-4413d5ab1021', 'volume_size': 1} Jul 01 04:12:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:29 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb" returned: 0 in 0.833s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:29 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb is being set with open permissions: ugo+rw Jul 01 04:12:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:29 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb Jul 01 04:12:29 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:30 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb" returned: 0 in 0.716s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:30 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.info Jul 01 04:12:30 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:30 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.info" returned: 0 in 0.642s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:30 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.info is being set with open permissions: ugo+rw Jul 01 04:12:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:30 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.info Jul 01 04:12:30 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:31 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.info" returned: 0 in 0.669s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.084s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.195s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1433496046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1703c579-72f6-43ea-8239-4413d5ab1021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadb54f88d0d467b87f81fc47dd57572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:12:29Z,use_quota=True,user_id='a387f0680e3844ebbb78d74566b7932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:12:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Creating volume 1703c579-72f6-43ea-8239-4413d5ab1021 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:12:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:12:31 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:12:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1703c579-72f6-43ea-8239-4413d5ab1021 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:31 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1703c579-72f6-43ea-8239-4413d5ab1021 1073741824 Jul 01 04:12:31 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:31 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-5be7f626-b0e0-4847-af39-e720b404d8cc tempest-VolumesSnapshotListTestJSON-1471433645 None] Create snapshot completed successfully Jul 01 04:12:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-cd1fdf88-0192-49a2-8906-a29606647e72 tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:32 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1703c579-72f6-43ea-8239-4413d5ab1021 1073741824" returned: 0 in 0.854s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1703c579-72f6-43ea-8239-4413d5ab1021 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:32 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1703c579-72f6-43ea-8239-4413d5ab1021 Jul 01 04:12:32 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:33 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1703c579-72f6-43ea-8239-4413d5ab1021" returned: 0 in 0.661s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:33 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:12:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-cd1fdf88-0192-49a2-8906-a29606647e72 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.173s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a3b1ee-83c5-4373-8400-1f5804eab9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1703c579-72f6-43ea-8239-4413d5ab1021', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ca1938-40d4-4064-a127-a6b9f626a82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:33 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-cd1fdf88-0192-49a2-8906-a29606647e72 tempest-VolumesSnapshotListTestJSON-1471433645 None] Creating offline snapshot d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c of volume ea1071df-a2fe-4110-bce1-58ae6b24a9c6 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:12:33 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Volume volume-1703c579-72f6-43ea-8239-4413d5ab1021 (1703c579-72f6-43ea-8239-4413d5ab1021): created successfully Jul 01 04:12:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ca1938-40d4-4064-a127-a6b9f626a82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Flow 'volume_create_manager' (90caa8d0-4f60-4c4d-b557-14256ab97708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:12:33 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4852ec31-738e-42d5-8db6-d0fb75f5255d]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cd1fdf88-0192-49a2-8906-a29606647e72 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:33 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-b7d67d8e-c23e-4998-a06c-954f08ef0825 tempest-VolumesListAdminTestJSON-1231310700 None] Created volume successfully. Jul 01 04:12:33 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb Jul 01 04:12:33 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:12:34 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Flow 'volume_create_manager' (ecd1ea91-20a0-42d6-8f2d-1c01021cd15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a60eec-8100-438f-98a5-ae42a7109fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cd1fdf88-0192-49a2-8906-a29606647e72 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb" returned: 0 in 0.844s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-cd1fdf88-0192-49a2-8906-a29606647e72 tempest-VolumesSnapshotListTestJSON-1471433645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cd1fdf88-0192-49a2-8906-a29606647e72 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a60eec-8100-438f-98a5-ae42a7109fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-849254537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d86b993b-37fe-4b5c-a0af-0a4beba327ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadb54f88d0d467b87f81fc47dd57572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:12:34Z,use_quota=True,user_id='a387f0680e3844ebbb78d74566b7932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:34 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c 1G Jul 01 04:12:34 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaefbc63-a8d4-40f1-8863-1afdc88093f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaefbc63-a8d4-40f1-8863-1afdc88093f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc20fa37-376a-4a2c-bc86-3e1795f2c711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc20fa37-376a-4a2c-bc86-3e1795f2c711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd86b993b-37fe-4b5c-a0af-0a4beba327ec', 'volume_name': 'volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1295332b-8b96-435e-bbef-68c9d13d35e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1295332b-8b96-435e-bbef-68c9d13d35e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41fca28-84aa-4ac1-862c-094760924e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:34 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Volume d86b993b-37fe-4b5c-a0af-0a4beba327ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec', 'volume_size': 1} Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:34 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cd1fdf88-0192-49a2-8906-a29606647e72 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c 1G" returned: 0 in 0.816s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cd1fdf88-0192-49a2-8906-a29606647e72 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:34 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c Jul 01 04:12:34 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:35 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cd1fdf88-0192-49a2-8906-a29606647e72 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c" returned: 0 in 0.701s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:35 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-cd1fdf88-0192-49a2-8906-a29606647e72 tempest-VolumesSnapshotListTestJSON-1471433645 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c is being set with open permissions: ugo+rw Jul 01 04:12:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cd1fdf88-0192-49a2-8906-a29606647e72 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:35 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c Jul 01 04:12:35 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:36 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cd1fdf88-0192-49a2-8906-a29606647e72 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c" returned: 0 in 0.634s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-cd1fdf88-0192-49a2-8906-a29606647e72 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.147s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.141s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-849254537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d86b993b-37fe-4b5c-a0af-0a4beba327ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadb54f88d0d467b87f81fc47dd57572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:12:34Z,use_quota=True,user_id='a387f0680e3844ebbb78d74566b7932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:12:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Creating volume d86b993b-37fe-4b5c-a0af-0a4beba327ec {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:12:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:12:36 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:12:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:36 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec 1073741824 Jul 01 04:12:36 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:36 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-cd1fdf88-0192-49a2-8906-a29606647e72 tempest-VolumesSnapshotListTestJSON-1471433645 None] Create snapshot completed successfully Jul 01 04:12:37 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec 1073741824" returned: 0 in 0.876s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:37 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec Jul 01 04:12:37 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-80c089c1-9e2a-45c7-8be1-60b8a19a7f65 tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:37 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec" returned: 0 in 0.663s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:12:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-80c089c1-9e2a-45c7-8be1-60b8a19a7f65 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.468s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-80c089c1-9e2a-45c7-8be1-60b8a19a7f65 tempest-VolumesSnapshotListTestJSON-1471433645 None] Creating offline snapshot e147f29c-65f7-4603-838f-a86bb9f3a04d of volume ea1071df-a2fe-4110-bce1-58ae6b24a9c6 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:12:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41fca28-84aa-4ac1-862c-094760924e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:37 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ba01cf-ede1-479f-bf30-c33a42b5fa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:37 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a93776-a449-405e-b7a9-ad85a9c4dcc5]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-80c089c1-9e2a-45c7-8be1-60b8a19a7f65 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:38 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Volume volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec (d86b993b-37fe-4b5c-a0af-0a4beba327ec): created successfully Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ba01cf-ede1-479f-bf30-c33a42b5fa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Flow 'volume_create_manager' (ecd1ea91-20a0-42d6-8f2d-1c01021cd15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:12:38 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-2e76bf6f-39d3-4dc5-9a7e-2171e9c6e6d9 tempest-VolumesListAdminTestJSON-1231310700 None] Created volume successfully. Jul 01 04:12:38 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c Jul 01 04:12:38 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Flow 'volume_create_manager' (4483594f-1f8e-4397-b973-469a64548f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cdcc1f-44da-4c8c-a4be-44f0d41dd5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cdcc1f-44da-4c8c-a4be-44f0d41dd5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-637820665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80224e47-819a-4991-9e0f-729634635590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadb54f88d0d467b87f81fc47dd57572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:12:39Z,use_quota=True,user_id='a387f0680e3844ebbb78d74566b7932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9749458-e385-4283-8d8c-db84db004170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9749458-e385-4283-8d8c-db84db004170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ac3d65-8b13-4717-a68b-e5e688f9fc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ac3d65-8b13-4717-a68b-e5e688f9fc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80224e47-819a-4991-9e0f-729634635590', 'volume_name': 'volume-80224e47-819a-4991-9e0f-729634635590', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:38 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bb5d92-2584-43ae-b5cc-8e1c3a871438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bb5d92-2584-43ae-b5cc-8e1c3a871438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58a0710-137f-46ea-95d6-8a437d1e676c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:38 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Volume 80224e47-819a-4991-9e0f-729634635590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80224e47-819a-4991-9e0f-729634635590', 'volume_size': 1} Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-80c089c1-9e2a-45c7-8be1-60b8a19a7f65 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c" returned: 0 in 0.794s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-80c089c1-9e2a-45c7-8be1-60b8a19a7f65 tempest-VolumesSnapshotListTestJSON-1471433645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:12:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-80c089c1-9e2a-45c7-8be1-60b8a19a7f65 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:38 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d 1G Jul 01 04:12:38 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:39 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-80c089c1-9e2a-45c7-8be1-60b8a19a7f65 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d 1G" returned: 0 in 0.849s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-80c089c1-9e2a-45c7-8be1-60b8a19a7f65 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:39 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d Jul 01 04:12:39 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:40 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-80c089c1-9e2a-45c7-8be1-60b8a19a7f65 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d" returned: 0 in 0.678s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:40 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-80c089c1-9e2a-45c7-8be1-60b8a19a7f65 tempest-VolumesSnapshotListTestJSON-1471433645 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d is being set with open permissions: ugo+rw Jul 01 04:12:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-80c089c1-9e2a-45c7-8be1-60b8a19a7f65 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:40 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d Jul 01 04:12:40 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:40 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-80c089c1-9e2a-45c7-8be1-60b8a19a7f65 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d" returned: 0 in 0.624s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-80c089c1-9e2a-45c7-8be1-60b8a19a7f65 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.075s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.200s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-637820665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80224e47-819a-4991-9e0f-729634635590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadb54f88d0d467b87f81fc47dd57572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:12:39Z,use_quota=True,user_id='a387f0680e3844ebbb78d74566b7932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:12:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Creating volume 80224e47-819a-4991-9e0f-729634635590 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:12:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:40 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:12:40 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:12:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-80224e47-819a-4991-9e0f-729634635590 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:41 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-80224e47-819a-4991-9e0f-729634635590 1073741824 Jul 01 04:12:41 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:41 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-80c089c1-9e2a-45c7-8be1-60b8a19a7f65 tempest-VolumesSnapshotListTestJSON-1471433645 None] Create snapshot completed successfully Jul 01 04:12:41 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-80224e47-819a-4991-9e0f-729634635590 1073741824" returned: 0 in 0.907s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-80224e47-819a-4991-9e0f-729634635590 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:41 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-80224e47-819a-4991-9e0f-729634635590 Jul 01 04:12:41 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "cinder-e147f29c-65f7-4603-838f-a86bb9f3a04d-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-e147f29c-65f7-4603-838f-a86bb9f3a04d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "cinder-quobyte-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-quobyte-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "cinder-quobyte-e147f29c-65f7-4603-838f-a86bb9f3a04d" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-quobyte-e147f29c-65f7-4603-838f-a86bb9f3a04d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Deleting offline snapshot e147f29c-65f7-4603-838f-a86bb9f3a04d of volume ea1071df-a2fe-4110-bce1-58ae6b24a9c6 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] snapshot_file for this snap is: volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7394b59-de17-4d25-b852-48fb9eb88109]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:42 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d Jul 01 04:12:42 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:42 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-80224e47-819a-4991-9e0f-729634635590" returned: 0 in 0.691s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58a0710-137f-46ea-95d6-8a437d1e676c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80224e47-819a-4991-9e0f-729634635590', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e229d4a-f4ae-456e-8712-81ef40bfdab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:42 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Volume volume-80224e47-819a-4991-9e0f-729634635590 (80224e47-819a-4991-9e0f-729634635590): created successfully Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e229d4a-f4ae-456e-8712-81ef40bfdab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Flow 'volume_create_manager' (4483594f-1f8e-4397-b973-469a64548f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:12:42 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-b00fdb69-a921-46fa-a43a-e337d55edc55 tempest-VolumesListAdminTestJSON-1231310700 None] Created volume successfully. Jul 01 04:12:43 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d" returned: 0 in 0.821s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9495d3-0f61-4813-944a-c1097524b88e]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:43 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c Jul 01 04:12:43 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Flow 'volume_create_manager' (07a04d7c-a7dc-459c-b6df-827e1ecb8727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17790032-3c6a-4308-a94e-0d57761f7077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17790032-3c6a-4308-a94e-0d57761f7077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f691f7-7874-4e32-b33c-9a6101961898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1a35e40be24b189d06c2cba64a8db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:12:44Z,use_quota=True,user_id='8bba7157f7dc4c56ab063589513658c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b69cfef-6cb8-4417-bca3-632e1bc5f192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b69cfef-6cb8-4417-bca3-632e1bc5f192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c44a8c2-6683-4e9e-b6b9-29506e2e78ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c44a8c2-6683-4e9e-b6b9-29506e2e78ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f691f7-7874-4e32-b33c-9a6101961898', 'volume_name': 'volume-94f691f7-7874-4e32-b33c-9a6101961898', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59eaa855-d70c-4f0f-b7f7-69524e237132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59eaa855-d70c-4f0f-b7f7-69524e237132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144120cd-c055-4730-abdf-daf41be22396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:43 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Volume 94f691f7-7874-4e32-b33c-9a6101961898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f691f7-7874-4e32-b33c-9a6101961898', 'volume_size': 1} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f691f7-7874-4e32-b33c-9a6101961898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1a35e40be24b189d06c2cba64a8db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:12:44Z,use_quota=True,user_id='8bba7157f7dc4c56ab063589513658c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Creating volume 94f691f7-7874-4e32-b33c-9a6101961898 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:12:43 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:12:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-94f691f7-7874-4e32-b33c-9a6101961898 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:43 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-94f691f7-7874-4e32-b33c-9a6101961898 1073741824 Jul 01 04:12:43 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:44 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c" returned: 0 in 0.850s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:12:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:44 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d Jul 01 04:12:44 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:44 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-94f691f7-7874-4e32-b33c-9a6101961898 1073741824" returned: 0 in 0.919s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-94f691f7-7874-4e32-b33c-9a6101961898 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:44 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-94f691f7-7874-4e32-b33c-9a6101961898 Jul 01 04:12:44 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:45 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d" returned: 0 in 0.911s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:45 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d Jul 01 04:12:45 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:45 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-94f691f7-7874-4e32-b33c-9a6101961898" returned: 0 in 0.668s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=67,cinder:INSERT=25,cinder:UPDATE=84,cinder:DELETE=11 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144120cd-c055-4730-abdf-daf41be22396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f691f7-7874-4e32-b33c-9a6101961898', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d11925-8733-42b4-9de5-03904c474f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:12:45 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Volume volume-94f691f7-7874-4e32-b33c-9a6101961898 (94f691f7-7874-4e32-b33c-9a6101961898): created successfully Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d11925-8733-42b4-9de5-03904c474f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Flow 'volume_create_manager' (07a04d7c-a7dc-459c-b6df-827e1ecb8727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:12:45 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-9b94bc24-0779-4bd7-91ed-cab70ab339e9 tempest-VolumesListAdminTestJSON-911536279 None] Created volume successfully. Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Acquiring lock "cinder-94f691f7-7874-4e32-b33c-9a6101961898-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Lock "cinder-94f691f7-7874-4e32-b33c-9a6101961898-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Acquiring lock "cinder-quobyte-94f691f7-7874-4e32-b33c-9a6101961898" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:45 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Lock "cinder-quobyte-94f691f7-7874-4e32-b33c-9a6101961898" acquired by "delete_volume" :: waited 0.035s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.e147f29c-65f7-4603-838f-a86bb9f3a04d" returned: 0 in 0.720s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fe4e99-a9ea-4b73-95f1-33c1d8478343]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-94f691f7-7874-4e32-b33c-9a6101961898 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-quobyte-e147f29c-65f7-4603-838f-a86bb9f3a04d" released by "_delete_snapshot" :: held 3.441s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-quobyte-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" released by "delete_snapshot" :: held 3.475s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Acquiring lock "cinder-80224e47-819a-4991-9e0f-729634635590-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "cinder-80224e47-819a-4991-9e0f-729634635590-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Acquiring lock "cinder-quobyte-80224e47-819a-4991-9e0f-729634635590" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "cinder-quobyte-80224e47-819a-4991-9e0f-729634635590" acquired by "delete_volume" :: waited 0.028s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Created reservations ['854b73b9-b18c-434e-8325-63d072d3fdcf', '9cfe759e-aa65-4989-8b11-bd0f725b12ef', 'a9a96938-cc18-42e1-8061-1dea9d6c6055', '110a09d7-9cf5-4703-a734-4ef793b8abf4'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3673c11b-2246-4f1c-af37-3f84d6f17973]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:46 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-94f691f7-7874-4e32-b33c-9a6101961898 Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-80224e47-819a-4991-9e0f-729634635590 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:46 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:46 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Delete snapshot completed successfully. Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-12a0f5cc-0fe7-4eba-9b96-dfe9d2c82270 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-e147f29c-65f7-4603-838f-a86bb9f3a04d-delete_snapshot" released by "delete_snapshot" :: held 3.719s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:46 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-80224e47-819a-4991-9e0f-729634635590 Jul 01 04:12:46 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "cinder-d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "cinder-quobyte-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-quobyte-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "cinder-quobyte-d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-quobyte-d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Deleting offline snapshot d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c of volume ea1071df-a2fe-4110-bce1-58ae6b24a9c6 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] snapshot_file for this snap is: volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a71e43f-738f-4dde-9f6b-5dd48344d9c6]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:46 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-94f691f7-7874-4e32-b33c-9a6101961898" returned: 0 in 0.959s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-94f691f7-7874-4e32-b33c-9a6101961898 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:46 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-94f691f7-7874-4e32-b33c-9a6101961898 Jul 01 04:12:46 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:46 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c Jul 01 04:12:46 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:46 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-80224e47-819a-4991-9e0f-729634635590" returned: 0 in 0.818s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-80224e47-819a-4991-9e0f-729634635590 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:46 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-80224e47-819a-4991-9e0f-729634635590 Jul 01 04:12:46 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:47 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-94f691f7-7874-4e32-b33c-9a6101961898" returned: 0 in 0.687s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:47 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Lock "cinder-quobyte-94f691f7-7874-4e32-b33c-9a6101961898" released by "delete_volume" :: held 1.711s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:47 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=80,cinder:INSERT=18,cinder:UPDATE=90,cinder:DELETE=6 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-80224e47-819a-4991-9e0f-729634635590" returned: 0 in 0.653s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c" returned: 0 in 0.808s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "cinder-quobyte-80224e47-819a-4991-9e0f-729634635590" released by "delete_volume" :: held 1.543s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d43fdd-7c62-414c-b6db-8671e494d82f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Created reservations ['da0d1eaa-4a35-4278-92eb-85c907559561', '19c908d5-d19d-4fc1-8e84-f3841b88536f', '37bf8707-c643-44fc-b763-d210aa02754c', 'f366f058-b2d9-4114-9d7a-581532ea07a9'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Created reservations ['6c6bcecc-90e1-4f8c-a51c-aef222dc6714', '69483ea9-a19f-444b-8130-26415d14e78d', '6462f5ce-c029-43eb-9a91-9a9481b745b7', '8b398892-815a-4443-a0e5-bfe4ae876060'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:12:47 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb Jul 01 04:12:47 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:47 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:12:47 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:47 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:12:47 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Acquiring lock "cinder-d86b993b-37fe-4b5c-a0af-0a4beba327ec-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "cinder-d86b993b-37fe-4b5c-a0af-0a4beba327ec-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Acquiring lock "cinder-quobyte-d86b993b-37fe-4b5c-a0af-0a4beba327ec" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:48 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb" returned: 0 in 0.854s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:12:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "cinder-quobyte-d86b993b-37fe-4b5c-a0af-0a4beba327ec" acquired by "delete_volume" :: waited 0.033s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:48 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c Jul 01 04:12:48 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:48 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbae431d-b071-44d4-a684-ab22d0af871d]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:48 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.807s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:48 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:12:48 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Deleted volume successfully. Jul 01 04:12:48 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec Jul 01 04:12:48 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-27eba965-42c4-4de3-b5b3-ed1db69d5155 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "cinder-80224e47-819a-4991-9e0f-729634635590-delete_volume" released by "delete_volume" :: held 2.674s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:48 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.938s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:48 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:12:48 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Deleted volume successfully. Jul 01 04:12:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c6d948fb-1e0f-48f6-9643-c536026c111a tempest-VolumesListAdminTestJSON-911536279 None] Lock "cinder-94f691f7-7874-4e32-b33c-9a6101961898-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:49 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec" returned: 0 in 0.828s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:49 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c" returned: 0 in 0.899s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:49 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec Jul 01 04:12:49 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:49 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c Jul 01 04:12:49 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:49 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c" returned: 0 in 0.642s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-quobyte-d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c" released by "_delete_snapshot" :: held 3.299s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:50 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d86b993b-37fe-4b5c-a0af-0a4beba327ec" returned: 0 in 0.683s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-quobyte-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" released by "delete_snapshot" :: held 3.331s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "cinder-quobyte-d86b993b-37fe-4b5c-a0af-0a4beba327ec" released by "delete_volume" :: held 1.570s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Created reservations ['bde51332-78fb-4576-a32b-e45669d5c0bc', '17fcf6a4-eff1-419b-92a0-9ecc186c4b4a', 'de9dd38a-0fc3-47ca-9032-1487367de7db', '1ec61136-4075-41a1-9ff7-597ac0f1085f'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Created reservations ['88d206f0-011f-4a58-bfe0-a3c1cf3483d1', 'd796578c-81c6-405b-b018-394cf9d8ec31', 'e73f3405-5926-43be-9236-7176af3e873e', 'a469a540-adaf-45f8-b18c-12d154e7a42a'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:50 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:12:50 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:50 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Delete snapshot completed successfully. Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bee49b8a-28ea-4fbb-9065-0beabc62f530 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-d0cf20cf-6552-4a4c-9b65-b1f0eeba3a8c-delete_snapshot" released by "delete_snapshot" :: held 3.551s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Acquiring lock "cinder-1703c579-72f6-43ea-8239-4413d5ab1021-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "cinder-1703c579-72f6-43ea-8239-4413d5ab1021-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Acquiring lock "cinder-quobyte-1703c579-72f6-43ea-8239-4413d5ab1021" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "cinder-quobyte-1703c579-72f6-43ea-8239-4413d5ab1021" acquired by "delete_volume" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73c369d-6cc3-42a2-9154-aa5177623156]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1703c579-72f6-43ea-8239-4413d5ab1021 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:50 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.683s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:12:50 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Deleted volume successfully. Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "cinder-8246c11c-4976-4fc8-904f-6e0228fc13cb-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3f84930f-c2fa-4d17-a21c-dbc3c359ec08 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "cinder-d86b993b-37fe-4b5c-a0af-0a4beba327ec-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-8246c11c-4976-4fc8-904f-6e0228fc13cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "cinder-quobyte-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-quobyte-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "cinder-quobyte-8246c11c-4976-4fc8-904f-6e0228fc13cb" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:50 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1703c579-72f6-43ea-8239-4413d5ab1021 Jul 01 04:12:50 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-quobyte-8246c11c-4976-4fc8-904f-6e0228fc13cb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Deleting offline snapshot 8246c11c-4976-4fc8-904f-6e0228fc13cb of volume ea1071df-a2fe-4110-bce1-58ae6b24a9c6 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:12:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] snapshot_file for this snap is: volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:12:51 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a891fac-ab89-4062-bd6a-8c0fe25c5202]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:51 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb Jul 01 04:12:51 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:51 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1703c579-72f6-43ea-8239-4413d5ab1021" returned: 0 in 0.837s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1703c579-72f6-43ea-8239-4413d5ab1021 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:51 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1703c579-72f6-43ea-8239-4413d5ab1021 Jul 01 04:12:51 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:51 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb" returned: 0 in 0.792s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:12:51 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c945ca1-6c4b-4fe3-8f11-3c2932816fbd]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:51 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 Jul 01 04:12:51 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-d8bb9fc3-290c-41b1-a872-9123f9f8b894 req-93e3a939-1499-4dbb-b8f3-b6adbdca8d3a tempest-TestServerVolumeAttachmentScenario-79102763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-d8bb9fc3-290c-41b1-a872-9123f9f8b894 req-93e3a939-1499-4dbb-b8f3-b6adbdca8d3a tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:52 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecbcebe-0ef2-40d2-b1c4-8457abc14539]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-d8bb9fc3-290c-41b1-a872-9123f9f8b894 req-93e3a939-1499-4dbb-b8f3-b6adbdca8d3a tempest-TestServerVolumeAttachmentScenario-79102763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1d8382d6-9aab-46a7-971a-522ed50e47d5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:52 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1d8382d6-9aab-46a7-971a-522ed50e47d5 Jul 01 04:12:52 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:52 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1703c579-72f6-43ea-8239-4413d5ab1021" returned: 0 in 0.707s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:52 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "cinder-quobyte-1703c579-72f6-43ea-8239-4413d5ab1021" released by "delete_volume" :: held 1.591s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:52 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Created reservations ['d0301bc2-be4d-4349-aa2b-c1ac7b8d8df7', 'e6f82130-2b56-4e26-a04f-51d9140acd5c', '53657f30-eadc-4821-a84c-d28fe347dbae', 'ed7ca605-029b-4882-ab45-6f4db4afe881'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:12:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:52 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:12:52 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:52 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" returned: 0 in 0.793s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:52 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb Jul 01 04:12:52 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:53 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-d8bb9fc3-290c-41b1-a872-9123f9f8b894 req-93e3a939-1499-4dbb-b8f3-b6adbdca8d3a tempest-TestServerVolumeAttachmentScenario-79102763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1d8382d6-9aab-46a7-971a-522ed50e47d5" returned: 0 in 0.851s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-d8bb9fc3-290c-41b1-a872-9123f9f8b894 req-93e3a939-1499-4dbb-b8f3-b6adbdca8d3a tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.869s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:53 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-d8bb9fc3-290c-41b1-a872-9123f9f8b894 req-93e3a939-1499-4dbb-b8f3-b6adbdca8d3a tempest-TestServerVolumeAttachmentScenario-79102763 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-1d8382d6-9aab-46a7-971a-522ed50e47d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f084380-9c8b-49e1-a0f9-aeb468f0b3bf', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:12:53 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-d8bb9fc3-290c-41b1-a872-9123f9f8b894 req-93e3a939-1499-4dbb-b8f3-b6adbdca8d3a tempest-TestServerVolumeAttachmentScenario-79102763 None] attachment_update completed successfully. Jul 01 04:12:53 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.744s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:53 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:12:53 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Deleted volume successfully. Jul 01 04:12:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f19249e6-a28b-4360-bc60-c26c17a2ec31 tempest-VolumesListAdminTestJSON-1231310700 None] Lock "cinder-1703c579-72f6-43ea-8239-4413d5ab1021-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:53 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb" returned: 0 in 0.826s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:53 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb Jul 01 04:12:53 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:54 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6.8246c11c-4976-4fc8-904f-6e0228fc13cb" returned: 0 in 0.728s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-quobyte-8246c11c-4976-4fc8-904f-6e0228fc13cb" released by "_delete_snapshot" :: held 3.259s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-quobyte-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" released by "delete_snapshot" :: held 3.284s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:54 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Created reservations ['80d99280-6847-48c0-81aa-4c2ace623cd8', '3bd540fe-6149-46ab-9358-c1152dd2130e', 'f1343670-eca2-455d-8109-1869d8e5c7c4', '7eca4ab9-b4cc-4011-ba7e-ca5cc57a0ffb'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:12:54 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Delete snapshot completed successfully. Jul 01 04:12:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-df3ab391-5f1c-4d47-89ef-955ac58f3659 tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-8246c11c-4976-4fc8-904f-6e0228fc13cb-delete_snapshot" released by "delete_snapshot" :: held 3.421s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "cinder-ea1071df-a2fe-4110-bce1-58ae6b24a9c6-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-ea1071df-a2fe-4110-bce1-58ae6b24a9c6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "cinder-quobyte-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:12:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-quobyte-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" acquired by "delete_volume" :: waited 0.022s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:12:55 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3ab4b2-fa69-41cd-ae72-b1b53661ba1b]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:12:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:55 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 Jul 01 04:12:55 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:56 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" returned: 0 in 0.788s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:56 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6 Jul 01 04:12:56 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:56 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" returned: 0 in 0.660s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-quobyte-ea1071df-a2fe-4110-bce1-58ae6b24a9c6" released by "delete_volume" :: held 1.530s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:12:56 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Created reservations ['7aa8f147-46a4-4d66-9f7f-8d3ffe66214a', 'd23f45cd-e1b9-4300-8425-4bc7275b9efb', 'cea4180c-d36e-4983-99f1-01d197b01990', 'db69f7de-7198-4e85-be35-b5200222af14'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:12:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:12:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:12:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:12:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:12:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:12:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:12:57 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:12:57 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:12:57 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 01 04:12:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.739s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:12:57 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:12:57 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Deleted volume successfully. Jul 01 04:12:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cd37e2ae-2d59-4a89-a648-81100901071d tempest-VolumesSnapshotListTestJSON-1471433645 None] Lock "cinder-ea1071df-a2fe-4110-bce1-58ae6b24a9c6-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Flow 'volume_create_manager' (0c99d813-e529-448a-a378-aa624a59a493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ac90af-455e-40de-88b2-c15985fbc588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ac90af-455e-40de-88b2-c15985fbc588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-108513691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530bcb18-289e-43f4-abc2-201ec819c7bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc5651d307541569190e9e754fc98b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:13:02Z,use_quota=True,user_id='6602b546bd68432ca7b473259df861bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735e71d6-7c61-45cb-92a9-2a92618583ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735e71d6-7c61-45cb-92a9-2a92618583ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3eb7e57-4fc7-45ff-90d8-e5ae9198ecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3eb7e57-4fc7-45ff-90d8-e5ae9198ecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '530bcb18-289e-43f4-abc2-201ec819c7bf', 'volume_name': 'volume-530bcb18-289e-43f4-abc2-201ec819c7bf', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2047ad68-f379-4c96-ae77-613f094c14af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2047ad68-f379-4c96-ae77-613f094c14af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d955f8b-d036-4f8c-80d4-b9bf5a6e759a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:02 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Volume 530bcb18-289e-43f4-abc2-201ec819c7bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-530bcb18-289e-43f4-abc2-201ec819c7bf', 'volume_size': 1} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-108513691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530bcb18-289e-43f4-abc2-201ec819c7bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc5651d307541569190e9e754fc98b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:13:02Z,use_quota=True,user_id='6602b546bd68432ca7b473259df861bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Creating volume 530bcb18-289e-43f4-abc2-201ec819c7bf {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:13:02 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:13:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-530bcb18-289e-43f4-abc2-201ec819c7bf 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:02 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-530bcb18-289e-43f4-abc2-201ec819c7bf 1073741824 Jul 01 04:13:02 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:03 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-530bcb18-289e-43f4-abc2-201ec819c7bf 1073741824" returned: 0 in 0.916s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-530bcb18-289e-43f4-abc2-201ec819c7bf {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:03 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-530bcb18-289e-43f4-abc2-201ec819c7bf Jul 01 04:13:03 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:03 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-530bcb18-289e-43f4-abc2-201ec819c7bf" returned: 0 in 0.689s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:13:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d955f8b-d036-4f8c-80d4-b9bf5a6e759a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530bcb18-289e-43f4-abc2-201ec819c7bf', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb895cd-f5ac-4bee-a4e7-087c15d24f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:03 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Volume volume-530bcb18-289e-43f4-abc2-201ec819c7bf (530bcb18-289e-43f4-abc2-201ec819c7bf): created successfully Jul 01 04:13:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb895cd-f5ac-4bee-a4e7-087c15d24f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:03 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Flow 'volume_create_manager' (0c99d813-e529-448a-a378-aa624a59a493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:13:03 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-cc8d1451-5587-4ea3-99c4-c7af13727540 tempest-VolumesTransfersV357Test-850470262 None] Created volume successfully. Jul 01 04:13:04 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-40dc6d71-02c7-47f9-84d4-adf6dd2f66f5 tempest-VolumesTransfersV357Test-1821423489 None] Transfer volume completed successfully. Jul 01 04:13:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-3c0d8fa5-c533-47df-b1b7-18f6c249b2c8 req-88f7ff07-0935-4860-af76-e869f126cfd7 tempest-TestServerVolumeAttachmentScenario-79102763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-3c0d8fa5-c533-47df-b1b7-18f6c249b2c8 req-88f7ff07-0935-4860-af76-e869f126cfd7 tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:05 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[005f2384-74ea-40fe-aae2-bcd7bac2c675]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:13:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-3c0d8fa5-c533-47df-b1b7-18f6c249b2c8 req-88f7ff07-0935-4860-af76-e869f126cfd7 tempest-TestServerVolumeAttachmentScenario-79102763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f1af5a66-3670-42eb-a390-767e132dfec6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:05 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f1af5a66-3670-42eb-a390-767e132dfec6 Jul 01 04:13:05 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Acquiring lock "cinder-530bcb18-289e-43f4-abc2-201ec819c7bf-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:13:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Lock "cinder-530bcb18-289e-43f4-abc2-201ec819c7bf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:13:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Acquiring lock "cinder-quobyte-530bcb18-289e-43f4-abc2-201ec819c7bf" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:13:05 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Lock "cinder-quobyte-530bcb18-289e-43f4-abc2-201ec819c7bf" acquired by "delete_volume" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:13:06 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[556ceddb-7895-4a52-a6bd-f03abbb3d57b]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:13:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-530bcb18-289e-43f4-abc2-201ec819c7bf {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:06 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-530bcb18-289e-43f4-abc2-201ec819c7bf Jul 01 04:13:06 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:06 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-3c0d8fa5-c533-47df-b1b7-18f6c249b2c8 req-88f7ff07-0935-4860-af76-e869f126cfd7 tempest-TestServerVolumeAttachmentScenario-79102763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f1af5a66-3670-42eb-a390-767e132dfec6" returned: 0 in 0.894s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-3c0d8fa5-c533-47df-b1b7-18f6c249b2c8 req-88f7ff07-0935-4860-af76-e869f126cfd7 tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.915s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-3c0d8fa5-c533-47df-b1b7-18f6c249b2c8 req-88f7ff07-0935-4860-af76-e869f126cfd7 tempest-TestServerVolumeAttachmentScenario-79102763 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-f1af5a66-3670-42eb-a390-767e132dfec6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '115390f6-c6e6-452b-9a12-ab426c896ddb', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:13:06 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-3c0d8fa5-c533-47df-b1b7-18f6c249b2c8 req-88f7ff07-0935-4860-af76-e869f126cfd7 tempest-TestServerVolumeAttachmentScenario-79102763 None] attachment_update completed successfully. Jul 01 04:13:06 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-530bcb18-289e-43f4-abc2-201ec819c7bf" returned: 0 in 0.927s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-530bcb18-289e-43f4-abc2-201ec819c7bf {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:06 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-530bcb18-289e-43f4-abc2-201ec819c7bf Jul 01 04:13:06 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:07 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-530bcb18-289e-43f4-abc2-201ec819c7bf" returned: 0 in 0.720s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Lock "cinder-quobyte-530bcb18-289e-43f4-abc2-201ec819c7bf" released by "delete_volume" :: held 1.705s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:13:07 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Created reservations ['91cde114-c67d-4c9a-92a1-8c9805c482f4', '249f0613-06ce-4cec-ad0c-c760440a745c', '1407540f-7470-460d-974d-da6a0bba8903', '2e66bfd9-3c36-41ba-a0a6-e7ca0163dfc2'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:13:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:07 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:13:07 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:13:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:07 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:13:07 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:08 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.772s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:13:08 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Deleted volume successfully. Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c50b24b0-f7bc-4724-8e3c-58f8b73cd7a9 tempest-VolumesTransfersV357Test-133429569 None] Lock "cinder-530bcb18-289e-43f4-abc2-201ec819c7bf-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Flow 'volume_create_manager' (f5e0f75b-ad99-456c-b874-f3fe1fd231da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fcb296-be14-43c9-9704-b9b69e0c9db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fcb296-be14-43c9-9704-b9b69e0c9db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-763440935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f461ba17-d4a4-456a-a1f2-3042368e9341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc5651d307541569190e9e754fc98b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:13:09Z,use_quota=True,user_id='6602b546bd68432ca7b473259df861bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7048ed-8ed3-45af-ab7e-26eb541268ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7048ed-8ed3-45af-ab7e-26eb541268ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8bbb9f-a500-4afc-9889-1f3b089ba131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8bbb9f-a500-4afc-9889-1f3b089ba131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f461ba17-d4a4-456a-a1f2-3042368e9341', 'volume_name': 'volume-f461ba17-d4a4-456a-a1f2-3042368e9341', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e026a3-f527-4f5b-a15a-6250a6aa73d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e026a3-f527-4f5b-a15a-6250a6aa73d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6305ffd7-8783-4f40-9b8e-057cb2d11816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:08 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Volume f461ba17-d4a4-456a-a1f2-3042368e9341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f461ba17-d4a4-456a-a1f2-3042368e9341', 'volume_size': 1} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-763440935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f461ba17-d4a4-456a-a1f2-3042368e9341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc5651d307541569190e9e754fc98b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:13:09Z,use_quota=True,user_id='6602b546bd68432ca7b473259df861bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Creating volume f461ba17-d4a4-456a-a1f2-3042368e9341 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:13:08 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:13:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f461ba17-d4a4-456a-a1f2-3042368e9341 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:08 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f461ba17-d4a4-456a-a1f2-3042368e9341 1073741824 Jul 01 04:13:08 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:09 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f461ba17-d4a4-456a-a1f2-3042368e9341 1073741824" returned: 0 in 1.002s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f461ba17-d4a4-456a-a1f2-3042368e9341 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:09 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f461ba17-d4a4-456a-a1f2-3042368e9341 Jul 01 04:13:09 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:10 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f461ba17-d4a4-456a-a1f2-3042368e9341" returned: 0 in 0.714s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:10 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:13:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6305ffd7-8783-4f40-9b8e-057cb2d11816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f461ba17-d4a4-456a-a1f2-3042368e9341', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc4dd26-c3fa-4e14-a492-dec1dc234bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:10 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Volume volume-f461ba17-d4a4-456a-a1f2-3042368e9341 (f461ba17-d4a4-456a-a1f2-3042368e9341): created successfully Jul 01 04:13:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc4dd26-c3fa-4e14-a492-dec1dc234bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Flow 'volume_create_manager' (f5e0f75b-ad99-456c-b874-f3fe1fd231da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:13:10 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-b1f21007-0531-4fc0-9ad2-798eef2e1d75 tempest-VolumesTransfersV357Test-850470262 None] Created volume successfully. Jul 01 04:13:12 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Acquiring lock "cinder-f461ba17-d4a4-456a-a1f2-3042368e9341-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:13:12 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Lock "cinder-f461ba17-d4a4-456a-a1f2-3042368e9341-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:13:12 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Acquiring lock "cinder-quobyte-f461ba17-d4a4-456a-a1f2-3042368e9341" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:13:12 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Lock "cinder-quobyte-f461ba17-d4a4-456a-a1f2-3042368e9341" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:13:12 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1481838-809e-409a-acc9-89d8dd31f2a9]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:13:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f461ba17-d4a4-456a-a1f2-3042368e9341 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:12 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f461ba17-d4a4-456a-a1f2-3042368e9341 Jul 01 04:13:12 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:13 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-14014a8a-c2cc-4403-848e-78e7b7ba31e2 req-4da170f4-1082-492b-a0e6-7f45d49e0c06 tempest-TestServerVolumeAttachmentScenario-79102763 None] Terminate volume connection completed successfully. Jul 01 04:13:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-14014a8a-c2cc-4403-848e-78e7b7ba31e2 req-4da170f4-1082-492b-a0e6-7f45d49e0c06 tempest-TestServerVolumeAttachmentScenario-79102763 None] Deleting attachment 115390f6-c6e6-452b-9a12-ab426c896ddb. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:13:13 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f461ba17-d4a4-456a-a1f2-3042368e9341" returned: 0 in 0.897s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f461ba17-d4a4-456a-a1f2-3042368e9341 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:13 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f461ba17-d4a4-456a-a1f2-3042368e9341 Jul 01 04:13:13 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:13 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f461ba17-d4a4-456a-a1f2-3042368e9341" returned: 0 in 0.689s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Lock "cinder-quobyte-f461ba17-d4a4-456a-a1f2-3042368e9341" released by "delete_volume" :: held 1.638s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:13:14 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Created reservations ['5e3ad463-6e83-45ea-a764-bc0e148ecc8b', '838e18da-dd90-4856-83f5-928f4882bc7f', 'd52789be-4888-4284-a106-0328d5aede86', 'f2835dbf-2128-4a65-986d-157b39e6fb1d'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:13:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:13:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:13:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:14 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:13:14 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:14 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.784s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:14 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:13:14 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Deleted volume successfully. Jul 01 04:13:14 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c39bdd74-5304-44f7-8aba-239492565122 tempest-VolumesTransfersV357Test-133429569 None] Lock "cinder-f461ba17-d4a4-456a-a1f2-3042368e9341-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:13:17 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-abfd3463-b86f-4430-b2ab-b66d0ba9fb07 req-baa2b7da-ad98-4672-bd2d-a358305bb2c7 tempest-TestServerVolumeAttachmentScenario-79102763 None] Terminate volume connection completed successfully. Jul 01 04:13:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-abfd3463-b86f-4430-b2ab-b66d0ba9fb07 req-baa2b7da-ad98-4672-bd2d-a358305bb2c7 tempest-TestServerVolumeAttachmentScenario-79102763 None] Deleting attachment 8f084380-9c8b-49e1-a0f9-aeb468f0b3bf. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Flow 'volume_create_manager' (6ee6b666-470c-4199-af77-369bafdaa35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbcce7a-92c5-4ab5-a7c7-325ca8eaab88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbcce7a-92c5-4ab5-a7c7-325ca8eaab88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1930322876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d135f50-73fb-4f00-ab8a-512d91306112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e16b17be5d34b328644224480a505e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:13:21Z,use_quota=True,user_id='f79befdc907a4035b2cafad949a6d588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d232aee-9ba2-4402-bb8c-bf47db822ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d232aee-9ba2-4402-bb8c-bf47db822ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a28f6b-2abd-4cbd-ae35-851fa1416e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a28f6b-2abd-4cbd-ae35-851fa1416e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d135f50-73fb-4f00-ab8a-512d91306112', 'volume_name': 'volume-7d135f50-73fb-4f00-ab8a-512d91306112', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885ca275-242e-4fb5-88fd-090e11e43620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885ca275-242e-4fb5-88fd-090e11e43620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd32b3df-0964-4944-ba99-ac374f918a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:21 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Volume 7d135f50-73fb-4f00-ab8a-512d91306112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d135f50-73fb-4f00-ab8a-512d91306112', 'volume_size': 1} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1930322876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d135f50-73fb-4f00-ab8a-512d91306112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e16b17be5d34b328644224480a505e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:13:21Z,use_quota=True,user_id='f79befdc907a4035b2cafad949a6d588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Creating volume 7d135f50-73fb-4f00-ab8a-512d91306112 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:13:21 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:13:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7d135f50-73fb-4f00-ab8a-512d91306112 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:21 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7d135f50-73fb-4f00-ab8a-512d91306112 1073741824 Jul 01 04:13:21 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:22 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7d135f50-73fb-4f00-ab8a-512d91306112 1073741824" returned: 0 in 1.003s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7d135f50-73fb-4f00-ab8a-512d91306112 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:22 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7d135f50-73fb-4f00-ab8a-512d91306112 Jul 01 04:13:22 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:23 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7d135f50-73fb-4f00-ab8a-512d91306112" returned: 0 in 0.941s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:13:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd32b3df-0964-4944-ba99-ac374f918a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d135f50-73fb-4f00-ab8a-512d91306112', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081e1c11-8c77-42e8-b188-ca43e909e715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:23 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Volume volume-7d135f50-73fb-4f00-ab8a-512d91306112 (7d135f50-73fb-4f00-ab8a-512d91306112): created successfully Jul 01 04:13:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081e1c11-8c77-42e8-b188-ca43e909e715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Flow 'volume_create_manager' (6ee6b666-470c-4199-af77-369bafdaa35f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:13:23 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-98e3d5d5-334a-4179-b0b9-de081b9661cc tempest-VolumesNegativeTest-779559331 None] Created volume successfully. Jul 01 04:13:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:13:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:13:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:13:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:24 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:13:24 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:25 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.954s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:13:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:13:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:13:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:13:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Acquiring lock "cinder-f1af5a66-3670-42eb-a390-767e132dfec6-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:13:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "cinder-f1af5a66-3670-42eb-a390-767e132dfec6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:13:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Acquiring lock "cinder-quobyte-f1af5a66-3670-42eb-a390-767e132dfec6" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:13:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "cinder-quobyte-f1af5a66-3670-42eb-a390-767e132dfec6" acquired by "delete_volume" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:13:27 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[697e8272-bab5-408b-82ef-8b58a1077281]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:13:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f1af5a66-3670-42eb-a390-767e132dfec6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:27 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f1af5a66-3670-42eb-a390-767e132dfec6 Jul 01 04:13:27 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:28 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f1af5a66-3670-42eb-a390-767e132dfec6" returned: 0 in 0.817s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f1af5a66-3670-42eb-a390-767e132dfec6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:28 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f1af5a66-3670-42eb-a390-767e132dfec6 Jul 01 04:13:28 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:29 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f1af5a66-3670-42eb-a390-767e132dfec6" returned: 0 in 0.691s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "cinder-quobyte-f1af5a66-3670-42eb-a390-767e132dfec6" released by "delete_volume" :: held 1.549s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:13:29 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Created reservations ['8487baa3-c438-48cd-b2a6-0f86518525f2', '938dbfa4-b3a7-4ffc-8c9b-b286ff0713aa', 'e17df0c3-7e31-47f8-940d-26ca2a66f89e', 'c7649f3c-e399-4516-b6d7-b6c07ed9195a'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:13:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:13:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:13:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:29 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:13:29 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Acquiring lock "cinder-1d8382d6-9aab-46a7-971a-522ed50e47d5-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "cinder-1d8382d6-9aab-46a7-971a-522ed50e47d5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Flow 'volume_create_manager' (cd06abf3-e8e4-495c-98eb-05a3e8ac6743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8dec8ec-0134-499a-887e-95c4b04745d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8dec8ec-0134-499a-887e-95c4b04745d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-196224298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5144f47f-3ef3-42a6-9b9d-020773844c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f135392486004beb80b4cd4a2975551f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:13:30Z,use_quota=True,user_id='13d814d328f241b1a151d8a867a17d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4eb56283-5526-4df4-b4cc-a3ed6d379dbd),volume_type_id=4eb56283-5526-4df4-b4cc-a3ed6d379dbd)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b085374-6b8f-41e8-b5ef-81e1524b2977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b085374-6b8f-41e8-b5ef-81e1524b2977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972b570c-1857-4120-a66b-5e624c0cd45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972b570c-1857-4120-a66b-5e624c0cd45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5144f47f-3ef3-42a6-9b9d-020773844c3e', 'volume_name': 'volume-5144f47f-3ef3-42a6-9b9d-020773844c3e', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556056be-9651-4bf0-be3d-d9282efa827a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556056be-9651-4bf0-be3d-d9282efa827a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a1d1ba-81ee-45dc-9f05-1975fa1e3a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:30 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Volume 5144f47f-3ef3-42a6-9b9d-020773844c3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5144f47f-3ef3-42a6-9b9d-020773844c3e', 'volume_size': 1} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-196224298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5144f47f-3ef3-42a6-9b9d-020773844c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f135392486004beb80b4cd4a2975551f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:13:30Z,use_quota=True,user_id='13d814d328f241b1a151d8a867a17d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4eb56283-5526-4df4-b4cc-a3ed6d379dbd),volume_type_id=4eb56283-5526-4df4-b4cc-a3ed6d379dbd)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Creating volume 5144f47f-3ef3-42a6-9b9d-020773844c3e {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:13:30 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5144f47f-3ef3-42a6-9b9d-020773844c3e 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Acquiring lock "cinder-quobyte-1d8382d6-9aab-46a7-971a-522ed50e47d5" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:13:30 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5144f47f-3ef3-42a6-9b9d-020773844c3e 1073741824 Jul 01 04:13:30 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "cinder-quobyte-1d8382d6-9aab-46a7-971a-522ed50e47d5" acquired by "delete_volume" :: waited 0.029s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3b236b-d197-430d-9689-27c9cac1852a]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1d8382d6-9aab-46a7-971a-522ed50e47d5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:30 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.991s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:13:30 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Deleted volume successfully. Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-fb352374-247f-4a26-a484-a3b8221394fe tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "cinder-f1af5a66-3670-42eb-a390-767e132dfec6-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:13:30 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1d8382d6-9aab-46a7-971a-522ed50e47d5 Jul 01 04:13:30 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Flow 'volume_create_manager' (e047b7f0-bfd4-464a-b9b1-e184046e510c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ef9609-6d0e-40f2-a843-d3949c0b260f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ef9609-6d0e-40f2-a843-d3949c0b260f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1554179592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f135392486004beb80b4cd4a2975551f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:13:31Z,use_quota=True,user_id='13d814d328f241b1a151d8a867a17d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b6422b1-0819-429b-a081-b57f28be6347),volume_type_id=0b6422b1-0819-429b-a081-b57f28be6347)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e665a469-fc13-4855-97c7-0b42a5ea5670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e665a469-fc13-4855-97c7-0b42a5ea5670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f5cd1e-e58b-454a-a221-4e6b201eca38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f5cd1e-e58b-454a-a221-4e6b201eca38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0', 'volume_name': 'volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fbebf6-188e-4e1e-bec3-abb931557916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fbebf6-188e-4e1e-bec3-abb931557916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704971a1-0402-4acb-9b90-c33fe372ddb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:30 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Volume 3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0', 'volume_size': 1} Jul 01 04:13:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:31 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1d8382d6-9aab-46a7-971a-522ed50e47d5" returned: 0 in 1.182s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1d8382d6-9aab-46a7-971a-522ed50e47d5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:31 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1d8382d6-9aab-46a7-971a-522ed50e47d5 Jul 01 04:13:31 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:31 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:13:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Flow 'volume_create_manager' (aa78177f-9615-42df-ab7e-e2647c2720c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:13:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879ee107-ee6e-4e70-94a7-fc6d0345bc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:31 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879ee107-ee6e-4e70-94a7-fc6d0345bc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-549121668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336dc9e8-29e8-4c47-ac4c-6017746af901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f135392486004beb80b4cd4a2975551f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:13:32Z,use_quota=True,user_id='13d814d328f241b1a151d8a867a17d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09825423-144e-4807-a950-1072d50d08f7),volume_type_id=09825423-144e-4807-a950-1072d50d08f7)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3a0d45-913a-466f-82cf-e77c46ba9cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3a0d45-913a-466f-82cf-e77c46ba9cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a7a4ec-7f0f-44ce-9aa7-67bfb15db1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:31 devstack cinder-volume[86177]: DEBUG cinder.image.glance [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Creating Keystone auth plugin from conf {{(pid=86177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 04:13:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5144f47f-3ef3-42a6-9b9d-020773844c3e 1073741824" returned: 0 in 1.575s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5144f47f-3ef3-42a6-9b9d-020773844c3e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:31 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5144f47f-3ef3-42a6-9b9d-020773844c3e Jul 01 04:13:31 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a7a4ec-7f0f-44ce-9aa7-67bfb15db1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '336dc9e8-29e8-4c47-ac4c-6017746af901', 'volume_name': 'volume-336dc9e8-29e8-4c47-ac4c-6017746af901', 'volume_size': 1, 'image_id': '99fac225-0bc2-42bf-ab23-479ef07f592b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99fac225-0bc2-42bf-ab23-479ef07f592b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--267134826', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f135392486004beb80b4cd4a2975551f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99fac225-0bc2-42bf-ab23-479ef07f592b', 'created_at': datetime.datetime(2026, 7, 1, 2, 13, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 2, 13, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99fac225-0bc2-42bf-ab23-479ef07f592b/file', 'properties': {}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a643f69-6bbf-4a86-bd72-be11782fc6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a643f69-6bbf-4a86-bd72-be11782fc6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ab5d31-20cf-42ad-a926-e0996c02b045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:32 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Volume 336dc9e8-29e8-4c47-ac4c-6017746af901: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-336dc9e8-29e8-4c47-ac4c-6017746af901', 'volume_size': 1, 'image_id': '99fac225-0bc2-42bf-ab23-479ef07f592b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99fac225-0bc2-42bf-ab23-479ef07f592b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--267134826', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f135392486004beb80b4cd4a2975551f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99fac225-0bc2-42bf-ab23-479ef07f592b', 'created_at': datetime.datetime(2026, 7, 1, 2, 13, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 2, 13, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99fac225-0bc2-42bf-ab23-479ef07f592b/file', 'properties': {}}, 'image_service': } Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Trying to clone 336dc9e8-29e8-4c47-ac4c-6017746af901 from image 99fac225-0bc2-42bf-ab23-479ef07f592b at location (None, [{'url': 'file:///opt/stack/data/glance/images/99fac225-0bc2-42bf-ab23-479ef07f592b', 'metadata': {}}]). {{(pid=86177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 04:13:32 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1d8382d6-9aab-46a7-971a-522ed50e47d5" returned: 0 in 1.238s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "cinder-quobyte-1d8382d6-9aab-46a7-971a-522ed50e47d5" released by "delete_volume" :: held 2.506s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:13:32 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5144f47f-3ef3-42a6-9b9d-020773844c3e" returned: 0 in 0.990s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] <== create_volume: return (2618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.621s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.925s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1554179592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f135392486004beb80b4cd4a2975551f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:13:31Z,use_quota=True,user_id='13d814d328f241b1a151d8a867a17d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b6422b1-0819-429b-a081-b57f28be6347),volume_type_id=0b6422b1-0819-429b-a081-b57f28be6347)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Creating volume 3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:13:32 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:32 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0 1073741824 Jul 01 04:13:32 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a1d1ba-81ee-45dc-9f05-1975fa1e3a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5144f47f-3ef3-42a6-9b9d-020773844c3e', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16914d31-2a2a-439c-bd52-ecf008601d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Created reservations ['e37cb9bb-ea9a-4a92-ad1f-1a59c3f14386', '6d25c19b-99e0-494b-b314-2f76d28db3d8', '7c5bcb6d-56a8-4ed0-9d47-183bdb2ff4ab', 'f2f97065-5496-4d5a-9e59-abdd7d5166fd'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:13:32 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Volume volume-5144f47f-3ef3-42a6-9b9d-020773844c3e (5144f47f-3ef3-42a6-9b9d-020773844c3e): created successfully Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16914d31-2a2a-439c-bd52-ecf008601d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Flow 'volume_create_manager' (cd06abf3-e8e4-495c-98eb-05a3e8ac6743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:13:33 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-59fecb4d-5f20-43eb-af17-9fc2a371d3db tempest-TestInstancesWithCinderVolumes-381131368 None] Created volume successfully. Jul 01 04:13:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:33 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:13:33 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:13:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:33 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:13:33 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:34 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.952s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:34 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:13:34 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Deleted volume successfully. Jul 01 04:13:34 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c036aa9-11f8-494f-ac7e-485f83150a5d tempest-TestServerVolumeAttachmentScenario-79102763 None] Lock "cinder-1d8382d6-9aab-46a7-971a-522ed50e47d5-delete_volume" released by "delete_volume" :: held 3.968s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:13:34 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0 1073741824" returned: 0 in 1.189s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:34 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0 Jul 01 04:13:34 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:34 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0" returned: 0 in 0.735s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:13:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704971a1-0402-4acb-9b90-c33fe372ddb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40810d9-eb40-414c-bd99-a7aa5ef3ea0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:34 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Volume volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0 (3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0): created successfully Jul 01 04:13:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40810d9-eb40-414c-bd99-a7aa5ef3ea0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Flow 'volume_create_manager' (e047b7f0-bfd4-464a-b9b1-e184046e510c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:13:34 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-6f318038-e323-477f-9118-97f7102eadd1 tempest-TestInstancesWithCinderVolumes-381131368 None] Created volume successfully. Jul 01 04:13:37 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_99fac225-0bc2-42bf-ab23-479ef07f592b_dp12g_zvdevstack@QuobyteHD, size 20.69 MB, duration 4.63 sec {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 04:13:37 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Image download 20.69 MB at 4.47 MB/s Jul 01 04:13:37 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a05964-74a0-443e-97c0-4479807e3a41]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:13:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99fac225-0bc2-42bf-ab23-479ef07f592b_dp12g_zvdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:37 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99fac225-0bc2-42bf-ab23-479ef07f592b_dp12g_zvdevstack@QuobyteHD Jul 01 04:13:37 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:37 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99fac225-0bc2-42bf-ab23-479ef07f592b_dp12g_zvdevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:37 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Temporary image 99fac225-0bc2-42bf-ab23-479ef07f592b is fetched for user 13d814d328f241b1a151d8a867a17d5d. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 04:13:38 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edb89b7-caf0-431b-a539-3c5864c1d2ce]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:13:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99fac225-0bc2-42bf-ab23-479ef07f592b_dp12g_zvdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:38 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99fac225-0bc2-42bf-ab23-479ef07f592b_dp12g_zvdevstack@QuobyteHD Jul 01 04:13:38 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:38 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99fac225-0bc2-42bf-ab23-479ef07f592b_dp12g_zvdevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-549121668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336dc9e8-29e8-4c47-ac4c-6017746af901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f135392486004beb80b4cd4a2975551f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:13:32Z,use_quota=True,user_id='13d814d328f241b1a151d8a867a17d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09825423-144e-4807-a950-1072d50d08f7),volume_type_id=09825423-144e-4807-a950-1072d50d08f7)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:13:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Creating volume 336dc9e8-29e8-4c47-ac4c-6017746af901 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:13:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:13:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:13:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:13:38 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:13:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:38 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 1073741824 Jul 01 04:13:38 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:40 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 1073741824" returned: 0 in 1.661s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:40 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 Jul 01 04:13:40 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:41 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901" returned: 0 in 0.834s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] <== create_volume: return (2553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:13:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.556s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:41 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Attempting download of 99fac225-0bc2-42bf-ab23-479ef07f592b ((None, [{'url': 'file:///opt/stack/data/glance/images/99fac225-0bc2-42bf-ab23-479ef07f592b', 'metadata': {}}])) to volume 336dc9e8-29e8-4c47-ac4c-6017746af901. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 04:13:41 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a11e305-035b-49a0-abea-44d838195bb4]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:13:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99fac225-0bc2-42bf-ab23-479ef07f592b_jp90wlbp {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:41 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99fac225-0bc2-42bf-ab23-479ef07f592b_jp90wlbp Jul 01 04:13:41 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:42 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99fac225-0bc2-42bf-ab23-479ef07f592b_jp90wlbp" returned: 0 in 1.169s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99fac225-0bc2-42bf-ab23-479ef07f592b_jp90wlbp {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:43 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99fac225-0bc2-42bf-ab23-479ef07f592b_jp90wlbp Jul 01 04:13:43 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:43 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99fac225-0bc2-42bf-ab23-479ef07f592b_jp90wlbp" returned: 1 in 1.001s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99fac225-0bc2-42bf-ab23-479ef07f592b_jp90wlbp' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:13:43 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[08775871-c3fc-4a72-b896-e6bb0d27d982]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:13:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99fac225-0bc2-42bf-ab23-479ef07f592b_dp12g_zvdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:43 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99fac225-0bc2-42bf-ab23-479ef07f592b_dp12g_zvdevstack@QuobyteHD Jul 01 04:13:43 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:44 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99fac225-0bc2-42bf-ab23-479ef07f592b_dp12g_zvdevstack@QuobyteHD" returned: 0 in 1.059s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:44 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] 99fac225-0bc2-42bf-ab23-479ef07f592b was qcow2, converting to raw {{(pid=86177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 04:13:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_99fac225-0bc2-42bf-ab23-479ef07f592b_dp12g_zvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:44 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_99fac225-0bc2-42bf-ab23-479ef07f592b_dp12g_zvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 Jul 01 04:13:44 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:47 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_99fac225-0bc2-42bf-ab23-479ef07f592b_dp12g_zvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901" returned: 0 in 2.214s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:47 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_99fac225-0bc2-42bf-ab23-479ef07f592b_dp12g_zvdevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:13:47 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Converted 112.00 MB image at 50.55 MB/s Jul 01 04:13:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:47 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 1G Jul 01 04:13:47 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:47 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 1G" returned: 0 in 0.786s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:47 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b9745c-7872-446f-a580-da9ff7d78209]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:13:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:48 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 Jul 01 04:13:48 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:48 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901" returned: 0 in 0.798s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:48 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 Jul 01 04:13:48 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:49 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901" returned: 1 in 0.792s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:13:49 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Downloaded image 99fac225-0bc2-42bf-ab23-479ef07f592b ((None, [{'url': 'file:///opt/stack/data/glance/images/99fac225-0bc2-42bf-ab23-479ef07f592b', 'metadata': {}}])) to volume 336dc9e8-29e8-4c47-ac4c-6017746af901 successfully. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 04:13:49 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Temporary image 99fac225-0bc2-42bf-ab23-479ef07f592b for user 13d814d328f241b1a151d8a867a17d5d is deleted. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 04:13:49 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Marking volume 336dc9e8-29e8-4c47-ac4c-6017746af901 as bootable. {{(pid=86177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 04:13:49 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=73,cinder:INSERT=29,cinder:UPDATE=97,cinder:DELETE=6 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:13:49 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Copying metadata from image 99fac225-0bc2-42bf-ab23-479ef07f592b to 336dc9e8-29e8-4c47-ac4c-6017746af901. {{(pid=86177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 04:13:49 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Creating volume glance metadata for volume 336dc9e8-29e8-4c47-ac4c-6017746af901 backed by image 99fac225-0bc2-42bf-ab23-479ef07f592b with: {'image_id': '99fac225-0bc2-42bf-ab23-479ef07f592b', 'image_name': 'tempest-scenario-img--267134826', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 04:13:49 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=93,cinder:INSERT=24,cinder:UPDATE=114,cinder:DELETE=8 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:13:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ab5d31-20cf-42ad-a926-e0996c02b045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336dc9e8-29e8-4c47-ac4c-6017746af901', 'volume_size': 1, 'image_id': '99fac225-0bc2-42bf-ab23-479ef07f592b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99fac225-0bc2-42bf-ab23-479ef07f592b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--267134826', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f135392486004beb80b4cd4a2975551f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99fac225-0bc2-42bf-ab23-479ef07f592b', 'created_at': datetime.datetime(2026, 7, 1, 2, 13, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 2, 13, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99fac225-0bc2-42bf-ab23-479ef07f592b/file', 'properties': {}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46a0179-7990-45f7-80d3-7f8b0d72508a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:13:49 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Volume volume-336dc9e8-29e8-4c47-ac4c-6017746af901 (336dc9e8-29e8-4c47-ac4c-6017746af901): created successfully Jul 01 04:13:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46a0179-7990-45f7-80d3-7f8b0d72508a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:13:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Flow 'volume_create_manager' (aa78177f-9615-42df-ab7e-e2647c2720c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:13:49 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-9e034bf2-a701-47de-8322-e5d0529a061c tempest-TestInstancesWithCinderVolumes-381131368 None] Created volume successfully. Jul 01 04:13:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Acquiring lock "cinder-7d135f50-73fb-4f00-ab8a-512d91306112-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:13:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Lock "cinder-7d135f50-73fb-4f00-ab8a-512d91306112-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:13:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Acquiring lock "cinder-quobyte-7d135f50-73fb-4f00-ab8a-512d91306112" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:13:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Lock "cinder-quobyte-7d135f50-73fb-4f00-ab8a-512d91306112" acquired by "delete_volume" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:13:57 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40d1d5a-0945-47e0-b144-e05dfa921b9c]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:13:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7d135f50-73fb-4f00-ab8a-512d91306112 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:57 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7d135f50-73fb-4f00-ab8a-512d91306112 Jul 01 04:13:57 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-b416d072-98f3-41d9-9eb5-74c725b521dc req-ae58e930-0aff-4e1d-8557-06fe01265cb7 tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-b416d072-98f3-41d9-9eb5-74c725b521dc req-ae58e930-0aff-4e1d-8557-06fe01265cb7 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:58 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4db678-f311-44ec-a353-d8382c72d23e]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:13:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-b416d072-98f3-41d9-9eb5-74c725b521dc req-ae58e930-0aff-4e1d-8557-06fe01265cb7 tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:58 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 Jul 01 04:13:58 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:58 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7d135f50-73fb-4f00-ab8a-512d91306112" returned: 0 in 1.076s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7d135f50-73fb-4f00-ab8a-512d91306112 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:58 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7d135f50-73fb-4f00-ab8a-512d91306112 Jul 01 04:13:58 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:59 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-b416d072-98f3-41d9-9eb5-74c725b521dc req-ae58e930-0aff-4e1d-8557-06fe01265cb7 tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901" returned: 0 in 1.052s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-b416d072-98f3-41d9-9eb5-74c725b521dc req-ae58e930-0aff-4e1d-8557-06fe01265cb7 tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:59 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 Jul 01 04:13:59 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:13:59 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Jul 01 04:13:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7d135f50-73fb-4f00-ab8a-512d91306112" returned: 0 in 0.824s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:13:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Lock "cinder-quobyte-7d135f50-73fb-4f00-ab8a-512d91306112" released by "delete_volume" :: held 1.966s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:13:59 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Created reservations ['b356ddd0-3ce2-4b38-b918-ca1957698079', 'ef979bd6-dcd2-494c-9063-3465fac7480f', 'a7e7b789-9aa3-4b5d-b4ff-1c521a840d74', 'aaca2577-fd1d-4385-87ea-f18cc746a31b'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:13:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:13:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:13:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:13:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:13:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:13:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:13:59 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:13:59 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:00 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-b416d072-98f3-41d9-9eb5-74c725b521dc req-ae58e930-0aff-4e1d-8557-06fe01265cb7 tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901" returned: 1 in 1.001s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-b416d072-98f3-41d9-9eb5-74c725b521dc req-ae58e930-0aff-4e1d-8557-06fe01265cb7 tempest-TestInstancesWithCinderVolumes-381131368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:14:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-b416d072-98f3-41d9-9eb5-74c725b521dc req-ae58e930-0aff-4e1d-8557-06fe01265cb7 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.117s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:14:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-b416d072-98f3-41d9-9eb5-74c725b521dc req-ae58e930-0aff-4e1d-8557-06fe01265cb7 tempest-TestInstancesWithCinderVolumes-381131368 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-336dc9e8-29e8-4c47-ac4c-6017746af901', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61ad25f4-c602-4bcd-b69d-1792fbb4d010', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:14:00 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-b416d072-98f3-41d9-9eb5-74c725b521dc req-ae58e930-0aff-4e1d-8557-06fe01265cb7 tempest-TestInstancesWithCinderVolumes-381131368 None] attachment_update completed successfully. Jul 01 04:14:00 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.948s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:00 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:14:00 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Deleted volume successfully. Jul 01 04:14:00 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bc80e99-c010-4580-a5d6-fde356a31656 tempest-VolumesNegativeTest-779559331 None] Lock "cinder-7d135f50-73fb-4f00-ab8a-512d91306112-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:14:10 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=16,cinder:INSERT=10,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:14:10 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=9,cinder:SELECT=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:14:21 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:14:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Flow 'volume_create_manager' (7c563f16-cf41-4863-8b24-bbd852b7b212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:14:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813ef967-0aad-414f-bf43-aaf9aadf8f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:14:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813ef967-0aad-414f-bf43-aaf9aadf8f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1547190620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7745d3-f63f-4b35-8b74-d2ffa988eecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024d1cad899b4db1bf9a3638f5f798e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:14:22Z,use_quota=True,user_id='b3fd0662c6b94322a96fb99b51411245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:14:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40a50ba-03dc-4528-8c3d-a74b32e2208b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:14:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40a50ba-03dc-4528-8c3d-a74b32e2208b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:14:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4902af6-fd0c-4c8c-8eab-e2eb7b7d3c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:14:21 devstack cinder-volume[86177]: DEBUG cinder.image.glance [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Creating Keystone auth plugin from conf {{(pid=86177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 04:14:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4902af6-fd0c-4c8c-8eab-e2eb7b7d3c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b7745d3-f63f-4b35-8b74-d2ffa988eecc', 'volume_name': 'volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc', 'volume_size': 1, 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43baa4017014b09a384294975690a79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'created_at': datetime.datetime(2026, 7, 1, 1, 52, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 1, 52, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:14:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfec6b0d-6502-477e-99bd-0848eab112e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:14:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfec6b0d-6502-477e-99bd-0848eab112e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:14:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b0e40d-a5e0-439c-83bd-871a0ea4fb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:14:22 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Volume 9b7745d3-f63f-4b35-8b74-d2ffa988eecc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc', 'volume_size': 1, 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43baa4017014b09a384294975690a79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'created_at': datetime.datetime(2026, 7, 1, 1, 52, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 1, 52, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 01 04:14:22 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Trying to clone 9b7745d3-f63f-4b35-8b74-d2ffa988eecc from image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 at location (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]). {{(pid=86177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 04:14:22 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ili2f281devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 04:14:22 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Image download 20.69 MB at 20.69 MB/s Jul 01 04:14:22 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1058d137-2e38-4e81-8e9d-8acc9a6729c2]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:14:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ili2f281devstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:23 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ili2f281devstack@QuobyteHD Jul 01 04:14:23 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:23 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ili2f281devstack@QuobyteHD" returned: 0 in 0.952s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:23 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Temporary image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 is fetched for user b3fd0662c6b94322a96fb99b51411245. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 04:14:23 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1997f1-c3cd-494b-a91c-121f9fcca2cf]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:14:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ili2f281devstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:24 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ili2f281devstack@QuobyteHD Jul 01 04:14:24 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:24 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:14:24 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:24 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ili2f281devstack@QuobyteHD" returned: 0 in 0.751s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1547190620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7745d3-f63f-4b35-8b74-d2ffa988eecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024d1cad899b4db1bf9a3638f5f798e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:14:22Z,use_quota=True,user_id='b3fd0662c6b94322a96fb99b51411245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Creating volume 9b7745d3-f63f-4b35-8b74-d2ffa988eecc {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:14:24 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:14:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:24 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc 1073741824 Jul 01 04:14:24 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:25 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.801s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:14:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:14:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:14:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:14:25 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc 1073741824" returned: 0 in 0.909s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:25 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc Jul 01 04:14:25 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:26 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc" returned: 0 in 0.765s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:14:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:14:26 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Attempting download of 44c37c3e-a2cd-450f-a8e6-b9270ee06395 ((None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}])) to volume 9b7745d3-f63f-4b35-8b74-d2ffa988eecc. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 04:14:26 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b16a644-434c-4b29-816e-6c95ae001f46]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:14:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_n3lgxkt8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:26 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_n3lgxkt8 Jul 01 04:14:26 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:27 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_n3lgxkt8" returned: 0 in 0.795s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_n3lgxkt8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:27 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_n3lgxkt8 Jul 01 04:14:27 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:28 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_n3lgxkt8" returned: 1 in 0.777s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_44c37c3e-a2cd-450f-a8e6-b9270ee06395_n3lgxkt8' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:14:28 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3544cde5-4320-44e1-9678-f2556f49ec67]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:14:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ili2f281devstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:28 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ili2f281devstack@QuobyteHD Jul 01 04:14:28 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:28 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ili2f281devstack@QuobyteHD" returned: 0 in 0.744s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:28 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] 44c37c3e-a2cd-450f-a8e6-b9270ee06395 was qcow2, converting to raw {{(pid=86177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 04:14:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ili2f281devstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:28 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ili2f281devstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc Jul 01 04:14:28 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:31 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ili2f281devstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc" returned: 0 in 2.364s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:31 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_44c37c3e-a2cd-450f-a8e6-b9270ee06395_ili2f281devstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:14:31 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Converted 112.00 MB image at 47.32 MB/s Jul 01 04:14:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:31 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc 1G Jul 01 04:14:31 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:32 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc 1G" returned: 0 in 0.876s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:32 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f1f307-04b8-4f3c-ae7d-a8b0ecfae72b]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:14:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:32 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc Jul 01 04:14:32 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:32 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc" returned: 0 in 0.867s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:33 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc Jul 01 04:14:33 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:33 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc" returned: 1 in 0.791s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:14:33 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Downloaded image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 ((None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}])) to volume 9b7745d3-f63f-4b35-8b74-d2ffa988eecc successfully. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 04:14:33 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Temporary image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 for user b3fd0662c6b94322a96fb99b51411245 is deleted. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 04:14:33 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Marking volume 9b7745d3-f63f-4b35-8b74-d2ffa988eecc as bootable. {{(pid=86177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 04:14:33 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Copying metadata from image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 to 9b7745d3-f63f-4b35-8b74-d2ffa988eecc. {{(pid=86177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 04:14:33 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Creating volume glance metadata for volume 9b7745d3-f63f-4b35-8b74-d2ffa988eecc backed by image 44c37c3e-a2cd-450f-a8e6-b9270ee06395 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 04:14:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b0e40d-a5e0-439c-83bd-871a0ea4fb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc', 'volume_size': 1, 'image_id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43baa4017014b09a384294975690a79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '44c37c3e-a2cd-450f-a8e6-b9270ee06395', 'created_at': datetime.datetime(2026, 7, 1, 1, 52, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 1, 52, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/44c37c3e-a2cd-450f-a8e6-b9270ee06395/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:14:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d446d3-572a-44e7-98b0-d713a92faa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:14:33 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Volume volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc (9b7745d3-f63f-4b35-8b74-d2ffa988eecc): created successfully Jul 01 04:14:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d446d3-572a-44e7-98b0-d713a92faa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:14:33 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Flow 'volume_create_manager' (7c563f16-cf41-4863-8b24-bbd852b7b212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:14:33 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0cced2c8-3d50-4a9e-bfd0-5f1982803cd4 tempest-TestShelveInstance-597985700 None] Created volume successfully. Jul 01 04:14:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-fc17301b-d3a0-45cc-8675-f85581c995d0 req-0be268df-f6b4-4de9-8f63-91a7d138ea54 tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:14:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-fc17301b-d3a0-45cc-8675-f85581c995d0 req-0be268df-f6b4-4de9-8f63-91a7d138ea54 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:14:35 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8d054a-8090-4666-aac9-509fe4cac851]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:14:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-fc17301b-d3a0-45cc-8675-f85581c995d0 req-0be268df-f6b4-4de9-8f63-91a7d138ea54 tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5144f47f-3ef3-42a6-9b9d-020773844c3e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:35 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5144f47f-3ef3-42a6-9b9d-020773844c3e Jul 01 04:14:35 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:36 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-fc17301b-d3a0-45cc-8675-f85581c995d0 req-0be268df-f6b4-4de9-8f63-91a7d138ea54 tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5144f47f-3ef3-42a6-9b9d-020773844c3e" returned: 0 in 0.847s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-fc17301b-d3a0-45cc-8675-f85581c995d0 req-0be268df-f6b4-4de9-8f63-91a7d138ea54 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.871s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:14:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-fc17301b-d3a0-45cc-8675-f85581c995d0 req-0be268df-f6b4-4de9-8f63-91a7d138ea54 tempest-TestInstancesWithCinderVolumes-381131368 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-5144f47f-3ef3-42a6-9b9d-020773844c3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b69f8846-efe8-4033-a911-29a498c3a6c4', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:14:36 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-fc17301b-d3a0-45cc-8675-f85581c995d0 req-0be268df-f6b4-4de9-8f63-91a7d138ea54 tempest-TestInstancesWithCinderVolumes-381131368 None] attachment_update completed successfully. Jul 01 04:14:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-6445f017-8487-4ada-a58c-60e3b39395e0 req-b7f902c8-c803-4ed0-913e-5e27124fb5b0 tempest-TestShelveInstance-597985700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:14:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-6445f017-8487-4ada-a58c-60e3b39395e0 req-b7f902c8-c803-4ed0-913e-5e27124fb5b0 tempest-TestShelveInstance-597985700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:14:44 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1308a6d-aa14-4ec4-b268-c5d3c6d27644]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:14:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-6445f017-8487-4ada-a58c-60e3b39395e0 req-b7f902c8-c803-4ed0-913e-5e27124fb5b0 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-b004fa73-868d-4de2-9827-153c738098f1 req-c29c4c78-3389-462e-a355-0868a7537cba tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:14:44 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc Jul 01 04:14:44 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:44 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-6445f017-8487-4ada-a58c-60e3b39395e0 req-b7f902c8-c803-4ed0-913e-5e27124fb5b0 tempest-TestShelveInstance-597985700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc" returned: 0 in 0.831s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-6445f017-8487-4ada-a58c-60e3b39395e0 req-b7f902c8-c803-4ed0-913e-5e27124fb5b0 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:44 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc Jul 01 04:14:44 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:45 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-6445f017-8487-4ada-a58c-60e3b39395e0 req-b7f902c8-c803-4ed0-913e-5e27124fb5b0 tempest-TestShelveInstance-597985700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc" returned: 1 in 0.797s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-6445f017-8487-4ada-a58c-60e3b39395e0 req-b7f902c8-c803-4ed0-913e-5e27124fb5b0 tempest-TestShelveInstance-597985700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:14:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-6445f017-8487-4ada-a58c-60e3b39395e0 req-b7f902c8-c803-4ed0-913e-5e27124fb5b0 tempest-TestShelveInstance-597985700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.700s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:14:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-b004fa73-868d-4de2-9827-153c738098f1 req-c29c4c78-3389-462e-a355-0868a7537cba tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.509s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:14:45 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43ba859-8d27-4388-8bd1-93a985d544db]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:14:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-b004fa73-868d-4de2-9827-153c738098f1 req-c29c4c78-3389-462e-a355-0868a7537cba tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:45 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-6445f017-8487-4ada-a58c-60e3b39395e0 req-b7f902c8-c803-4ed0-913e-5e27124fb5b0 tempest-TestShelveInstance-597985700 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f0cfe98-02a3-461f-a4ea-5784e4b5e242', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:14:45 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-6445f017-8487-4ada-a58c-60e3b39395e0 req-b7f902c8-c803-4ed0-913e-5e27124fb5b0 tempest-TestShelveInstance-597985700 None] attachment_update completed successfully. Jul 01 04:14:45 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0 Jul 01 04:14:45 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:14:46 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Jul 01 04:14:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-b004fa73-868d-4de2-9827-153c738098f1 req-c29c4c78-3389-462e-a355-0868a7537cba tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0" returned: 0 in 0.807s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:14:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-b004fa73-868d-4de2-9827-153c738098f1 req-c29c4c78-3389-462e-a355-0868a7537cba tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.837s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:14:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-b004fa73-868d-4de2-9827-153c738098f1 req-c29c4c78-3389-462e-a355-0868a7537cba tempest-TestInstancesWithCinderVolumes-381131368 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68f5e18e-af70-42d3-8c21-14c9bd4780b6', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:14:46 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-b004fa73-868d-4de2-9827-153c738098f1 req-c29c4c78-3389-462e-a355-0868a7537cba tempest-TestInstancesWithCinderVolumes-381131368 None] attachment_update completed successfully. Jul 01 04:14:56 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=31,cinder:INSERT=10,cinder:UPDATE=10 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:14:56 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=8,cinder:SELECT=21,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:14:57 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-cd544fe1-9cf0-4dab-a528-c179a3be3fbb req-b3ccb21a-00d4-4ff7-a734-10e0b2ee6916 tempest-TestInstancesWithCinderVolumes-381131368 None] Terminate volume connection completed successfully. Jul 01 04:14:57 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-cd544fe1-9cf0-4dab-a528-c179a3be3fbb req-b3ccb21a-00d4-4ff7-a734-10e0b2ee6916 tempest-TestInstancesWithCinderVolumes-381131368 None] Deleting attachment b69f8846-efe8-4033-a911-29a498c3a6c4. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:14:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "cinder-5144f47f-3ef3-42a6-9b9d-020773844c3e-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:14:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "cinder-5144f47f-3ef3-42a6-9b9d-020773844c3e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:14:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "cinder-quobyte-5144f47f-3ef3-42a6-9b9d-020773844c3e" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:14:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "cinder-quobyte-5144f47f-3ef3-42a6-9b9d-020773844c3e" acquired by "delete_volume" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:14:59 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a727a3f-b922-41ed-921b-8eda1ec743e1]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:14:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5144f47f-3ef3-42a6-9b9d-020773844c3e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:14:59 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5144f47f-3ef3-42a6-9b9d-020773844c3e Jul 01 04:14:59 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:00 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5144f47f-3ef3-42a6-9b9d-020773844c3e" returned: 0 in 0.931s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5144f47f-3ef3-42a6-9b9d-020773844c3e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:00 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5144f47f-3ef3-42a6-9b9d-020773844c3e Jul 01 04:15:00 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:01 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5144f47f-3ef3-42a6-9b9d-020773844c3e" returned: 0 in 0.706s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "cinder-quobyte-5144f47f-3ef3-42a6-9b9d-020773844c3e" released by "delete_volume" :: held 1.708s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:15:01 devstack cinder-volume[86177]: WARNING cinder.quota [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1551108113-1333077282 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1551108113-1333077282, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:15:01 devstack cinder-volume[86177]: WARNING cinder.quota [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1551108113-1333077282 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1551108113-1333077282, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:15:01 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Created reservations ['eb500d04-550f-4c8b-89a0-5ecf0bf04660', '01dac2c7-d1f7-4ca6-8bb1-64cf0a3f0512', '67870272-de06-4f59-b400-818df894206b', 'f8f98bab-2f91-4a7f-9a1e-1f6188a78316'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:15:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:15:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:15:01 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:15:01 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:15:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:15:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:01 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:15:01 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:01 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.671s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:01 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:15:01 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Deleted volume successfully. Jul 01 04:15:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-c87b8d51-0dee-46d6-bc55-d37e6cb9b016 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "cinder-5144f47f-3ef3-42a6-9b9d-020773844c3e-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:15:04 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-c665ef8c-f743-4482-93fc-4a9801a23915 req-829040ca-7a6c-47f6-bf72-c6d147b8cb69 tempest-TestInstancesWithCinderVolumes-381131368 None] Terminate volume connection completed successfully. Jul 01 04:15:04 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-c665ef8c-f743-4482-93fc-4a9801a23915 req-829040ca-7a6c-47f6-bf72-c6d147b8cb69 tempest-TestInstancesWithCinderVolumes-381131368 None] Deleting attachment 68f5e18e-af70-42d3-8c21-14c9bd4780b6. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:15:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "cinder-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:15:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "cinder-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:15:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "cinder-quobyte-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:15:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "cinder-quobyte-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0" acquired by "delete_volume" :: waited 0.037s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:15:06 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c7432a-ee2c-4704-9291-1a1fe08226e4]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:15:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:06 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0 Jul 01 04:15:06 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:07 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0" returned: 0 in 0.879s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:07 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0 Jul 01 04:15:07 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:08 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0" returned: 0 in 0.843s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:08 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "cinder-quobyte-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0" released by "delete_volume" :: held 1.786s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:15:08 devstack cinder-volume[86177]: WARNING cinder.quota [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2125288518-2079110875 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2125288518-2079110875, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:15:08 devstack cinder-volume[86177]: WARNING cinder.quota [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2125288518-2079110875 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2125288518-2079110875, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:15:08 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Created reservations ['aa44a202-2870-4d7a-83ba-aef9a73a25ee', '9fdda9ae-f8ab-4b91-a84e-63c70bf4ac3a', 'eeeff073-f7cd-4f8c-bc1e-fea266fde9e6', '61e4f8a1-bd0d-40f2-9843-913fedc6832c'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:15:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:15:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:15:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:15:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:15:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:15:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:08 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:15:08 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:09 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.014s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:09 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:15:09 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Deleted volume successfully. Jul 01 04:15:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d28b3c03-b28e-4d64-aef4-e4fd06986fe0 tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "cinder-3ae0b9d8-e405-43fb-bf5b-6ae18116b8e0-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:15:12 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:15:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Flow 'volume_create_manager' (eb8cc0d6-1a8e-4035-8650-6a1e441def67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:15:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d41385a-9482-4b11-92ca-17821d99eed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:15:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d41385a-9482-4b11-92ca-17821d99eed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2096022265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a70b6b2c-f1db-4263-b09a-a7a93c993e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18c3af6dcca4731bbcc1cf401aa200b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:15:13Z,use_quota=True,user_id='3200760d11b0490cb01839dbdec2a6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360ef7ad-38c8-464d-9d96-83b8c6371a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360ef7ad-38c8-464d-9d96-83b8c6371a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db14d9c1-fd14-477b-9c03-2d51cd70e3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db14d9c1-fd14-477b-9c03-2d51cd70e3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a70b6b2c-f1db-4263-b09a-a7a93c993e70', 'volume_name': 'volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8055e0b7-8065-4b39-8665-07ab557cb7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8055e0b7-8065-4b39-8665-07ab557cb7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10804ca7-ceb5-4667-855f-b7d6b4a55df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:15:13 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Volume a70b6b2c-f1db-4263-b09a-a7a93c993e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70', 'volume_size': 1} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2096022265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a70b6b2c-f1db-4263-b09a-a7a93c993e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18c3af6dcca4731bbcc1cf401aa200b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:15:13Z,use_quota=True,user_id='3200760d11b0490cb01839dbdec2a6f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Creating volume a70b6b2c-f1db-4263-b09a-a7a93c993e70 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:15:13 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:13 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70 1073741824 Jul 01 04:15:13 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:13 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-f9c89de2-088d-4fe3-a3e0-16dfe3511de8 req-5e21be0c-1c74-4bf6-83fd-39460b04f3da tempest-TestInstancesWithCinderVolumes-381131368 None] Terminate volume connection completed successfully. Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-f9c89de2-088d-4fe3-a3e0-16dfe3511de8 req-5e21be0c-1c74-4bf6-83fd-39460b04f3da tempest-TestInstancesWithCinderVolumes-381131368 None] Deleting attachment 61ad25f4-c602-4bcd-b69d-1792fbb4d010. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:15:13 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70 1073741824" returned: 0 in 0.865s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:13 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70 Jul 01 04:15:13 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:14 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70" returned: 0 in 0.652s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:15:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:15:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10804ca7-ceb5-4667-855f-b7d6b4a55df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:15:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91207ce0-89c3-4f94-be19-5752844cf4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:15:14 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Volume volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70 (a70b6b2c-f1db-4263-b09a-a7a93c993e70): created successfully Jul 01 04:15:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91207ce0-89c3-4f94-be19-5752844cf4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:15:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Flow 'volume_create_manager' (eb8cc0d6-1a8e-4035-8650-6a1e441def67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:15:14 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f65827cc-18c2-47f0-9178-6bb358678c7b tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Created volume successfully. Jul 01 04:15:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "cinder-336dc9e8-29e8-4c47-ac4c-6017746af901-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:15:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "cinder-336dc9e8-29e8-4c47-ac4c-6017746af901-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:15:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "cinder-quobyte-336dc9e8-29e8-4c47-ac4c-6017746af901" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:15:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "cinder-quobyte-336dc9e8-29e8-4c47-ac4c-6017746af901" acquired by "delete_volume" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:15:17 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac417231-0cd2-466b-bdb2-f472f7c6dca1]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:15:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:17 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 Jul 01 04:15:17 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:18 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901" returned: 0 in 0.843s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-8b440f72-8d24-4414-946b-3f6c624093e3 req-17214a02-328a-440d-9d76-63f8ff9f00fb tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:15:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-8b440f72-8d24-4414-946b-3f6c624093e3 req-17214a02-328a-440d-9d76-63f8ff9f00fb tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:15:18 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[161a783e-3c5d-47c1-a23a-0b2767e82dd8]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:15:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-8b440f72-8d24-4414-946b-3f6c624093e3 req-17214a02-328a-440d-9d76-63f8ff9f00fb tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:18 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 Jul 01 04:15:18 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:18 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70 Jul 01 04:15:18 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:18 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901" returned: 1 in 0.819s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:15:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:18 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-8b440f72-8d24-4414-946b-3f6c624093e3 req-17214a02-328a-440d-9d76-63f8ff9f00fb tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70" returned: 0 in 0.793s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-8b440f72-8d24-4414-946b-3f6c624093e3 req-17214a02-328a-440d-9d76-63f8ff9f00fb tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.813s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:15:18 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901 Jul 01 04:15:18 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:19 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-8b440f72-8d24-4414-946b-3f6c624093e3 req-17214a02-328a-440d-9d76-63f8ff9f00fb tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bad7a5b1-5a0e-4ad4-bf67-f0bc6e13cd79', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:15:19 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-8b440f72-8d24-4414-946b-3f6c624093e3 req-17214a02-328a-440d-9d76-63f8ff9f00fb tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] attachment_update completed successfully. Jul 01 04:15:19 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-336dc9e8-29e8-4c47-ac4c-6017746af901" returned: 0 in 0.654s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "cinder-quobyte-336dc9e8-29e8-4c47-ac4c-6017746af901" released by "delete_volume" :: held 2.392s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:15:19 devstack cinder-volume[86177]: WARNING cinder.quota [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-82563116-1127862774 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-82563116-1127862774, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:15:19 devstack cinder-volume[86177]: WARNING cinder.quota [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-82563116-1127862774 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-82563116-1127862774, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:15:19 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Created reservations ['1e5ce558-c24b-42df-80b0-9ff15a506514', '6412509f-2244-475a-9e12-260d90764c73', '0775c387-4ebf-4e31-a69f-b42e15863454', 'a3bc5547-1f29-476a-8561-2fe7990fbdbf'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:15:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:15:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:15:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:15:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:15:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:15:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:19 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:15:19 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:20 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.839s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:20 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:15:20 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Deleted volume successfully. Jul 01 04:15:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f85713ed-8ac3-4017-a810-e1ae00b087bc tempest-TestInstancesWithCinderVolumes-381131368 None] Lock "cinder-336dc9e8-29e8-4c47-ac4c-6017746af901-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:15:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:15:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:15:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:15:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:15:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:15:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:15:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:24 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:15:24 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:24 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-c0355ea3-4ec8-4285-9a5c-cc6cfb62261f req-51bbb0d0-ea35-4a0b-bf21-fdd322cc200e tempest-TestShelveInstance-597985700 None] Terminate volume connection completed successfully. Jul 01 04:15:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-c0355ea3-4ec8-4285-9a5c-cc6cfb62261f req-51bbb0d0-ea35-4a0b-bf21-fdd322cc200e tempest-TestShelveInstance-597985700 None] Deleting attachment 7f0cfe98-02a3-461f-a4ea-5784e4b5e242. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:15:25 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.769s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:15:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:15:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:15:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:15:25 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-5b996093-10c5-4a53-9114-6e5456950b4a req-27c1693e-e30b-451d-be61-387bfed968ec tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Terminate volume connection completed successfully. Jul 01 04:15:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-5b996093-10c5-4a53-9114-6e5456950b4a req-27c1693e-e30b-451d-be61-387bfed968ec tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Deleting attachment bad7a5b1-5a0e-4ad4-bf67-f0bc6e13cd79. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:15:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Acquiring lock "cinder-a70b6b2c-f1db-4263-b09a-a7a93c993e70-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:15:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Lock "cinder-a70b6b2c-f1db-4263-b09a-a7a93c993e70-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:15:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Acquiring lock "cinder-quobyte-a70b6b2c-f1db-4263-b09a-a7a93c993e70" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:15:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Lock "cinder-quobyte-a70b6b2c-f1db-4263-b09a-a7a93c993e70" acquired by "delete_volume" :: waited 0.014s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:15:27 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[991cc6d9-de65-4232-834a-a3d2c0ec1ba6]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:15:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:27 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70 Jul 01 04:15:27 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:28 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70" returned: 0 in 0.921s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:28 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70 Jul 01 04:15:28 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:29 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a70b6b2c-f1db-4263-b09a-a7a93c993e70" returned: 0 in 0.744s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Lock "cinder-quobyte-a70b6b2c-f1db-4263-b09a-a7a93c993e70" released by "delete_volume" :: held 1.717s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:15:29 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Created reservations ['04cddee0-18c0-456b-a641-d5ecab72ee76', '2c0b6b55-1f48-428b-988f-2fda51ff19c5', 'd5331116-af4d-4063-8db2-b268c623b0a8', 'ee7357a8-b88a-40cc-9548-01f6cfcbb31f'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:15:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:15:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:15:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:15:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:15:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:15:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:29 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:15:29 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-01b14c7e-132e-481c-8aec-6b0d71eab801 req-a16af3e3-d1eb-47e7-be4f-b49221b1d0bf tempest-TestShelveInstance-597985700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:15:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-01b14c7e-132e-481c-8aec-6b0d71eab801 req-a16af3e3-d1eb-47e7-be4f-b49221b1d0bf tempest-TestShelveInstance-597985700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:15:29 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[533e9b7a-10a8-4fe2-bbcb-e97d0dbd5701]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:15:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-01b14c7e-132e-481c-8aec-6b0d71eab801 req-a16af3e3-d1eb-47e7-be4f-b49221b1d0bf tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:30 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc Jul 01 04:15:30 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:30 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.867s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:30 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:15:30 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Deleted volume successfully. Jul 01 04:15:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-18d8b481-7fa7-40f4-b066-4308c5980045 tempest-TestServerVolumeAttachScenarioOldVersion-1156156032 None] Lock "cinder-a70b6b2c-f1db-4263-b09a-a7a93c993e70-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:15:30 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-01b14c7e-132e-481c-8aec-6b0d71eab801 req-a16af3e3-d1eb-47e7-be4f-b49221b1d0bf tempest-TestShelveInstance-597985700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc" returned: 0 in 0.915s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-01b14c7e-132e-481c-8aec-6b0d71eab801 req-a16af3e3-d1eb-47e7-be4f-b49221b1d0bf tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:15:30 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc Jul 01 04:15:30 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:15:31 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jul 01 04:15:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-01b14c7e-132e-481c-8aec-6b0d71eab801 req-a16af3e3-d1eb-47e7-be4f-b49221b1d0bf tempest-TestShelveInstance-597985700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc" returned: 1 in 1.107s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:15:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-01b14c7e-132e-481c-8aec-6b0d71eab801 req-a16af3e3-d1eb-47e7-be4f-b49221b1d0bf tempest-TestShelveInstance-597985700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:15:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-01b14c7e-132e-481c-8aec-6b0d71eab801 req-a16af3e3-d1eb-47e7-be4f-b49221b1d0bf tempest-TestShelveInstance-597985700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.077s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:15:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-01b14c7e-132e-481c-8aec-6b0d71eab801 req-a16af3e3-d1eb-47e7-be4f-b49221b1d0bf tempest-TestShelveInstance-597985700 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd870c333-0abc-4b88-a715-fdb1e2b62172', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:15:32 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-01b14c7e-132e-481c-8aec-6b0d71eab801 req-a16af3e3-d1eb-47e7-be4f-b49221b1d0bf tempest-TestShelveInstance-597985700 None] attachment_update completed successfully. Jul 01 04:15:42 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=36,cinder:INSERT=9,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:15:42 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=41,cinder:UPDATE=45,cinder:INSERT=8,cinder:DELETE=4 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Flow 'volume_create_manager' (f6e3c029-0ae8-48c2-bf15-2eac3214d819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097c6e1d-f1ab-4016-9747-18503a7be30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097c6e1d-f1ab-4016-9747-18503a7be30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-59903813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e262d46a-e0f1-4fe1-84de-7bf322fb0c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='499fc1203ae54d6682d38feb08cad811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:16:00Z,use_quota=True,user_id='8235c92600bd49c99f4c992faa4f9983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb35e101-200a-4768-a195-cec94a13a478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb35e101-200a-4768-a195-cec94a13a478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e4cbbd-55c1-43a7-b849-98122d40b186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e4cbbd-55c1-43a7-b849-98122d40b186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e262d46a-e0f1-4fe1-84de-7bf322fb0c48', 'volume_name': 'volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d951df-f02f-4aaa-a3ae-ead7178d47f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d951df-f02f-4aaa-a3ae-ead7178d47f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e44d70-14d7-4078-8145-cdaa1ab060ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:00 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Volume e262d46a-e0f1-4fe1-84de-7bf322fb0c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48', 'volume_size': 1} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-59903813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e262d46a-e0f1-4fe1-84de-7bf322fb0c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='499fc1203ae54d6682d38feb08cad811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:16:00Z,use_quota=True,user_id='8235c92600bd49c99f4c992faa4f9983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Creating volume e262d46a-e0f1-4fe1-84de-7bf322fb0c48 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:16:00 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:16:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:00 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 1073741824 Jul 01 04:16:00 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:01 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 1073741824" returned: 0 in 1.050s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:01 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 Jul 01 04:16:01 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:02 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48" returned: 0 in 0.881s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:16:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:16:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e44d70-14d7-4078-8145-cdaa1ab060ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974eadd5-c2a3-4ec5-966e-33f7566ae5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:02 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Volume volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 (e262d46a-e0f1-4fe1-84de-7bf322fb0c48): created successfully Jul 01 04:16:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974eadd5-c2a3-4ec5-966e-33f7566ae5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Flow 'volume_create_manager' (f6e3c029-0ae8-48c2-bf15-2eac3214d819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:16:02 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-2a79ea39-ba0e-439e-b369-02dac2a4a6c3 tempest-SnapshotDependencyTests-1291654219 None] Created volume successfully. Jul 01 04:16:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:16:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:16:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] Creating offline snapshot 07efcb56-11cd-4a0c-86a2-78250096a8c3 of volume e262d46a-e0f1-4fe1-84de-7bf322fb0c48 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:16:03 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a46d45-ba41-4b8b-97aa-c427cfdacb81]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:16:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:04 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 Jul 01 04:16:04 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:05 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48" returned: 0 in 1.282s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:05 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 1G Jul 01 04:16:05 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:06 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 1G" returned: 0 in 1.255s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:06 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 Jul 01 04:16:06 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:07 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3" returned: 0 in 0.974s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:07 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 is being set with open permissions: ugo+rw Jul 01 04:16:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:07 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 Jul 01 04:16:07 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:08 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3" returned: 0 in 0.744s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:08 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.info Jul 01 04:16:08 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:08 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.info" returned: 0 in 0.718s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:08 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.info is being set with open permissions: ugo+rw Jul 01 04:16:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:08 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.info Jul 01 04:16:08 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:09 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.info" returned: 0 in 0.690s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.800s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:16:09 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d4d3497b-5c7e-4375-9a1f-c58b6c43df28 tempest-SnapshotDependencyTests-1291654219 None] Create snapshot completed successfully Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Flow 'volume_create_manager' (82dfdbeb-e196-482d-8fff-459c7cde5ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18225d23-2d7a-4a6f-84cb-3b1aeac81e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18225d23-2d7a-4a6f-84cb-3b1aeac81e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b71e24-4297-473a-99ef-01eb28a11720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='499fc1203ae54d6682d38feb08cad811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=07efcb56-11cd-4a0c-86a2-78250096a8c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:16:11Z,use_quota=True,user_id='8235c92600bd49c99f4c992faa4f9983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7b40fe-8d2e-4fad-a36e-9b45920ba9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7b40fe-8d2e-4fad-a36e-9b45920ba9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f456ab5d-af39-4e17-84d2-a896b973f4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f456ab5d-af39-4e17-84d2-a896b973f4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13b71e24-4297-473a-99ef-01eb28a11720', 'volume_name': 'volume-13b71e24-4297-473a-99ef-01eb28a11720', 'volume_size': 1, 'snapshot_id': '07efcb56-11cd-4a0c-86a2-78250096a8c3'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab1208d-50ec-492e-99de-4d16616b6cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab1208d-50ec-492e-99de-4d16616b6cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063e7e4e-3cc6-4e5e-9f15-c38669d0554f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:10 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Volume 13b71e24-4297-473a-99ef-01eb28a11720: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13b71e24-4297-473a-99ef-01eb28a11720', 'volume_size': 1, 'snapshot_id': '07efcb56-11cd-4a0c-86a2-78250096a8c3'} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "cinder-quobyte-07efcb56-11cd-4a0c-86a2-78250096a8c3-13b71e24-4297-473a-99ef-01eb28a11720" by "_create_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-quobyte-07efcb56-11cd-4a0c-86a2-78250096a8c3-13b71e24-4297-473a-99ef-01eb28a11720" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Creating volume 13b71e24-4297-473a-99ef-01eb28a11720 from snapshot 07efcb56-11cd-4a0c-86a2-78250096a8c3 {{(pid=86177) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "cinder-quobyte-13b71e24-4297-473a-99ef-01eb28a11720" by "_copy_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-quobyte-13b71e24-4297-473a-99ef-01eb28a11720" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:16:10 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] snapshot: 07efcb56-11cd-4a0c-86a2-78250096a8c3, volume: 13b71e24-4297-473a-99ef-01eb28a11720, {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 04:16:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:16:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:16:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:16:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:16:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:16:11 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9985f7-54b9-46e7-a4d5-029a682b29ab]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:16:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:11 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 Jul 01 04:16:11 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:11 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3" returned: 0 in 0.836s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:16:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 04:16:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Creating direct copy from snapshot {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 04:16:11 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b78e97-b775-480f-b03a-8501735546a1]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:16:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:12 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 Jul 01 04:16:12 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:12 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48" returned: 0 in 0.795s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:12 devstack cinder-volume[86177]: DEBUG cinder.utils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Path /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-13b71e24-4297-473a-99ef-01eb28a11720 not found in is_blk_device check {{(pid=86177) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 04:16:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-13b71e24-4297-473a-99ef-01eb28a11720 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:12 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-13b71e24-4297-473a-99ef-01eb28a11720 Jul 01 04:16:12 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:19 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-13b71e24-4297-473a-99ef-01eb28a11720" returned: 0 in 6.356s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:19 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8881661b-690d-4900-8d88-a26e3900ddbb]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:16:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:19 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 Jul 01 04:16:19 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:20 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48" returned: 0 in 0.959s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:20 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Image conversion details: src /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-13b71e24-4297-473a-99ef-01eb28a11720 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:16:20 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Converted 1024.00 MB image at 161.03 MB/s Jul 01 04:16:20 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-13b71e24-4297-473a-99ef-01eb28a11720 is being set with open permissions: ugo+rw Jul 01 04:16:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-13b71e24-4297-473a-99ef-01eb28a11720 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:20 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-13b71e24-4297-473a-99ef-01eb28a11720 Jul 01 04:16:20 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:20 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-13b71e24-4297-473a-99ef-01eb28a11720" returned: 0 in 0.696s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-quobyte-13b71e24-4297-473a-99ef-01eb28a11720" released by "_copy_volume_from_snapshot" :: held 9.864s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:16:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-quobyte-07efcb56-11cd-4a0c-86a2-78250096a8c3-13b71e24-4297-473a-99ef-01eb28a11720" released by "_create_volume_from_snapshot" :: held 9.905s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:16:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.938s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:16:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063e7e4e-3cc6-4e5e-9f15-c38669d0554f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b71e24-4297-473a-99ef-01eb28a11720', 'volume_size': 1, 'snapshot_id': '07efcb56-11cd-4a0c-86a2-78250096a8c3'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4adef76a-b481-40c0-a964-3a8c6aa49aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:20 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Volume volume-13b71e24-4297-473a-99ef-01eb28a11720 (13b71e24-4297-473a-99ef-01eb28a11720): created successfully Jul 01 04:16:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4adef76a-b481-40c0-a964-3a8c6aa49aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Flow 'volume_create_manager' (82dfdbeb-e196-482d-8fff-459c7cde5ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:16:20 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1a3c913a-cb17-45ea-a214-70ddf33c9c24 tempest-SnapshotDependencyTests-1291654219 None] Created volume successfully. Jul 01 04:16:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "cinder-07efcb56-11cd-4a0c-86a2-78250096a8c3-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:16:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-07efcb56-11cd-4a0c-86a2-78250096a8c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:16:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "cinder-quobyte-e262d46a-e0f1-4fe1-84de-7bf322fb0c48" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:16:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-quobyte-e262d46a-e0f1-4fe1-84de-7bf322fb0c48" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:16:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "cinder-quobyte-07efcb56-11cd-4a0c-86a2-78250096a8c3" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:16:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-quobyte-07efcb56-11cd-4a0c-86a2-78250096a8c3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:16:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Deleting offline snapshot 07efcb56-11cd-4a0c-86a2-78250096a8c3 of volume e262d46a-e0f1-4fe1-84de-7bf322fb0c48 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:16:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] snapshot_file for this snap is: volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:16:21 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[674c2834-bfbd-47ee-b769-c46dd0cd06dd]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:16:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:22 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 Jul 01 04:16:22 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Flow 'volume_create_manager' (5147bdbf-dfef-4816-b323-d25975a557ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0412b2-429e-4725-a2ea-e239f3c5981f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0412b2-429e-4725-a2ea-e239f3c5981f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1372300269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50227ac-6dac-4323-8c18-758f6747c72f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79aa4937dd204092a7451a9b4e6bcc4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:16:22Z,use_quota=True,user_id='2897ce6d688c43519a40bd9193b54122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c9ee63-d0de-40b5-a376-f882966966f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c9ee63-d0de-40b5-a376-f882966966f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9384e9f-964c-4ba3-9fb9-888459ba1691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9384e9f-964c-4ba3-9fb9-888459ba1691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b50227ac-6dac-4323-8c18-758f6747c72f', 'volume_name': 'volume-b50227ac-6dac-4323-8c18-758f6747c72f', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb47559c-c1da-4246-99bf-90689fcd9653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb47559c-c1da-4246-99bf-90689fcd9653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ab45f4-ed2c-4dd2-88d6-ba21bd21ccb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:22 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Volume b50227ac-6dac-4323-8c18-758f6747c72f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b50227ac-6dac-4323-8c18-758f6747c72f', 'volume_size': 1} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1372300269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50227ac-6dac-4323-8c18-758f6747c72f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79aa4937dd204092a7451a9b4e6bcc4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:16:22Z,use_quota=True,user_id='2897ce6d688c43519a40bd9193b54122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Creating volume b50227ac-6dac-4323-8c18-758f6747c72f {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:16:22 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:22 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f 1073741824 Jul 01 04:16:22 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:22 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3" returned: 0 in 0.796s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4878abf-c78e-4a73-a5af-1c7bd06137ff]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:16:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:22 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 Jul 01 04:16:22 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:23 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f 1073741824" returned: 0 in 0.968s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:23 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f Jul 01 04:16:23 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:23 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48" returned: 0 in 0.830s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:23 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 Jul 01 04:16:23 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:24 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f" returned: 0 in 0.716s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ab45f4-ed2c-4dd2-88d6-ba21bd21ccb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b50227ac-6dac-4323-8c18-758f6747c72f', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049bae32-2402-4d7a-a03a-13ba87f6d053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:24 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Volume volume-b50227ac-6dac-4323-8c18-758f6747c72f (b50227ac-6dac-4323-8c18-758f6747c72f): created successfully Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049bae32-2402-4d7a-a03a-13ba87f6d053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Flow 'volume_create_manager' (5147bdbf-dfef-4816-b323-d25975a557ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:16:24 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-a0014f47-08c8-4b9a-b4fa-c3e4fca951cd tempest-TestStampPattern-1782510108 None] Created volume successfully. Jul 01 04:16:24 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3" returned: 0 in 0.767s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:24 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3 Jul 01 04:16:24 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:16:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:24 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:16:24 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:25 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48.07efcb56-11cd-4a0c-86a2-78250096a8c3" returned: 0 in 0.691s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-quobyte-07efcb56-11cd-4a0c-86a2-78250096a8c3" released by "_delete_snapshot" :: held 3.200s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:16:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-quobyte-e262d46a-e0f1-4fe1-84de-7bf322fb0c48" released by "delete_snapshot" :: held 3.224s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:16:25 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Created reservations ['8e632d14-7e91-4c6c-8ae6-b6586813c8fb', '77bc5896-63ab-4aff-87bc-acf134b5ef00', '36d748e7-ef3d-4aa2-9a12-10be9bd009c6', 'febbfaba-f8e8-466c-9609-97e7f0540874'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:16:25 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.672s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:16:25 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Delete snapshot completed successfully. Jul 01 04:16:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:16:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:16:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:16:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d883a5cf-1311-4a23-87c4-39b9dce53093 tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-07efcb56-11cd-4a0c-86a2-78250096a8c3-delete_snapshot" released by "delete_snapshot" :: held 3.370s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:16:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "cinder-e262d46a-e0f1-4fe1-84de-7bf322fb0c48-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:16:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-e262d46a-e0f1-4fe1-84de-7bf322fb0c48-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:16:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "cinder-quobyte-e262d46a-e0f1-4fe1-84de-7bf322fb0c48" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:16:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-quobyte-e262d46a-e0f1-4fe1-84de-7bf322fb0c48" acquired by "delete_volume" :: waited 0.014s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:16:26 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[545ed6e7-f48c-48a2-86e3-87003dd46c94]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:16:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:26 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 Jul 01 04:16:26 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:26 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48" returned: 0 in 0.775s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:26 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48 Jul 01 04:16:26 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:27 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e262d46a-e0f1-4fe1-84de-7bf322fb0c48" returned: 0 in 0.643s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-quobyte-e262d46a-e0f1-4fe1-84de-7bf322fb0c48" released by "delete_volume" :: held 1.473s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:16:27 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Created reservations ['abedf5b1-6bbc-40a5-88f5-f8c20c59b861', 'd5d0acbf-0fc3-4e40-9ef1-41092e63eed6', '22659695-98d5-4953-85bd-5f03f655c5e1', '584d3207-01f4-486e-a4ba-7798ed62f4a5'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:16:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:16:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:16:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:16:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:16:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:16:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:27 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:16:27 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "cinder-13b71e24-4297-473a-99ef-01eb28a11720-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:16:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-13b71e24-4297-473a-99ef-01eb28a11720-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:16:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "cinder-quobyte-13b71e24-4297-473a-99ef-01eb28a11720" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:16:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-quobyte-13b71e24-4297-473a-99ef-01eb28a11720" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:16:28 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67766dc-0c77-4995-9cee-69eafa94806f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:16:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-13b71e24-4297-473a-99ef-01eb28a11720 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:28 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.842s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:28 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:16:28 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Deleted volume successfully. Jul 01 04:16:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-af9f355d-1cef-48a9-9a5f-6d6d419d5f27 tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-e262d46a-e0f1-4fe1-84de-7bf322fb0c48-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:16:28 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-13b71e24-4297-473a-99ef-01eb28a11720 Jul 01 04:16:28 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:29 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-13b71e24-4297-473a-99ef-01eb28a11720" returned: 0 in 0.827s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-13b71e24-4297-473a-99ef-01eb28a11720 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:29 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-13b71e24-4297-473a-99ef-01eb28a11720 Jul 01 04:16:29 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:30 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-13b71e24-4297-473a-99ef-01eb28a11720" returned: 0 in 0.793s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-quobyte-13b71e24-4297-473a-99ef-01eb28a11720" released by "delete_volume" :: held 1.677s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:16:30 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Created reservations ['d7e9618c-77c3-4361-9ed2-fc49cb8cecd2', 'bc4b7dd8-0e0a-4e11-a78c-c3a1c8ee5461', 'fc920211-742f-48b8-8ffd-b61b4717d77e', '9c64000e-1398-4d7d-9fb7-9ae8aec11095'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:16:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:16:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:16:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:16:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:16:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:16:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:30 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:16:30 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:31 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.787s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:31 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:16:31 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Deleted volume successfully. Jul 01 04:16:31 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-33d3e3ba-dd4d-4003-8bed-c3b58b3b6fcb tempest-SnapshotDependencyTests-1291654219 None] Lock "cinder-13b71e24-4297-473a-99ef-01eb28a11720-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:16:35 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-00366d97-0c59-4db5-88e8-50820782afdf req-415e7ba6-0888-4bd4-8527-0c54b3be4b4b tempest-TestShelveInstance-597985700 None] Terminate volume connection completed successfully. Jul 01 04:16:35 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-00366d97-0c59-4db5-88e8-50820782afdf req-415e7ba6-0888-4bd4-8527-0c54b3be4b4b tempest-TestShelveInstance-597985700 None] Deleting attachment d870c333-0abc-4b88-a715-fdb1e2b62172. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:16:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Acquiring lock "cinder-9b7745d3-f63f-4b35-8b74-d2ffa988eecc-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:16:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Lock "cinder-9b7745d3-f63f-4b35-8b74-d2ffa988eecc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:16:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Acquiring lock "cinder-quobyte-9b7745d3-f63f-4b35-8b74-d2ffa988eecc" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:16:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Lock "cinder-quobyte-9b7745d3-f63f-4b35-8b74-d2ffa988eecc" acquired by "delete_volume" :: waited 0.028s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:16:36 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9d0d41-973c-46a0-a3f9-cc8dd890778a]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:16:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:36 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc Jul 01 04:16:36 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:36 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc" returned: 0 in 0.909s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:37 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc Jul 01 04:16:37 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:37 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc" returned: 1 in 0.977s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:16:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:37 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc Jul 01 04:16:37 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:38 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b7745d3-f63f-4b35-8b74-d2ffa988eecc" returned: 0 in 0.973s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:38 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Lock "cinder-quobyte-9b7745d3-f63f-4b35-8b74-d2ffa988eecc" released by "delete_volume" :: held 2.970s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:16:39 devstack cinder-volume[86177]: DEBUG cinder.quota [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Created reservations ['4606b526-47f6-494f-b48a-ada7dcdfd4ef', 'b8f54b49-8c34-4c83-8e85-9cafa14597a4', '45e93955-7b7d-41e3-9ca3-dacf64709ed7', '444b1b6c-ae58-43a4-af84-f9e83c4f9574'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:16:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:16:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:16:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:16:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:16:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:16:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:39 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:16:39 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:40 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.097s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:40 devstack cinder-volume[86177]: DEBUG cinder.manager [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:16:40 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Deleted volume successfully. Jul 01 04:16:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [req-00366d97-0c59-4db5-88e8-50820782afdf req-7a1e8052-7d45-41be-a5f5-58ce7fed4c58 tempest-TestShelveInstance-597985700 None] Lock "cinder-9b7745d3-f63f-4b35-8b74-d2ffa988eecc-delete_volume" released by "delete_volume" :: held 4.476s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:16:49 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=43,cinder:SELECT=31,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:16:50 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=32,cinder:UPDATE=35,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:16:55 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:16:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Flow 'volume_create_manager' (51078ab1-a4c3-4f39-a2cb-bf918ca4e81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:16:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974cd39d-c63b-4b7c-8e6a-b07718dc2664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974cd39d-c63b-4b7c-8e6a-b07718dc2664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44128f4-acb6-445f-8d15-4828a7e9a14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95de8dacb40a4889aaadf3f23d2e43c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:16:56Z,use_quota=True,user_id='b0f16251918e4f3cb4f9491c4cec5901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb91d7fd-cc6b-4bfe-a314-c4698f296492),volume_type_id=eb91d7fd-cc6b-4bfe-a314-c4698f296492)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab70301-3d28-46d3-8da8-b1f74e47d2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab70301-3d28-46d3-8da8-b1f74e47d2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5dfb1b-04cd-4912-9cbc-ac3cac2fb238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:55 devstack cinder-volume[86177]: DEBUG cinder.image.glance [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Creating Keystone auth plugin from conf {{(pid=86177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 04:16:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5dfb1b-04cd-4912-9cbc-ac3cac2fb238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd44128f4-acb6-445f-8d15-4828a7e9a14f', 'volume_name': 'volume-d44128f4-acb6-445f-8d15-4828a7e9a14f', 'volume_size': 1, 'image_id': '25d1f4e7-a5a4-4447-99a7-9519eb1e85e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25d1f4e7-a5a4-4447-99a7-9519eb1e85e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c0c7fd8688d2bd5da21eb8aca5c5d46a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '95de8dacb40a4889aaadf3f23d2e43c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7499b7c40a4f40381bf99ff0e58e4b720094568acb74d1deab21ceeb4d8e242452f594d33b7e4f30f7102afdb58849eb09acee306553701142233cc43cb28278', 'id': '25d1f4e7-a5a4-4447-99a7-9519eb1e85e8', 'created_at': datetime.datetime(2026, 7, 1, 2, 16, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 2, 16, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25d1f4e7-a5a4-4447-99a7-9519eb1e85e8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c668ab5-5b93-4edf-af15-93b7d18bf77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c668ab5-5b93-4edf-af15-93b7d18bf77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:16:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51cf4ef-706d-4b4c-8170-980e4dca1ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:16:55 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Volume d44128f4-acb6-445f-8d15-4828a7e9a14f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d44128f4-acb6-445f-8d15-4828a7e9a14f', 'volume_size': 1, 'image_id': '25d1f4e7-a5a4-4447-99a7-9519eb1e85e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25d1f4e7-a5a4-4447-99a7-9519eb1e85e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c0c7fd8688d2bd5da21eb8aca5c5d46a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '95de8dacb40a4889aaadf3f23d2e43c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7499b7c40a4f40381bf99ff0e58e4b720094568acb74d1deab21ceeb4d8e242452f594d33b7e4f30f7102afdb58849eb09acee306553701142233cc43cb28278', 'id': '25d1f4e7-a5a4-4447-99a7-9519eb1e85e8', 'created_at': datetime.datetime(2026, 7, 1, 2, 16, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 2, 16, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25d1f4e7-a5a4-4447-99a7-9519eb1e85e8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 01 04:16:55 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Trying to clone d44128f4-acb6-445f-8d15-4828a7e9a14f from image 25d1f4e7-a5a4-4447-99a7-9519eb1e85e8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/25d1f4e7-a5a4-4447-99a7-9519eb1e85e8', 'metadata': {}}]). {{(pid=86177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 04:16:56 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 04:16:56 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Image download 0.00 MB at 0.00 MB/s Jul 01 04:16:56 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4104da-c352-4fbd-966c-3d4e4eed5ba4]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:16:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:56 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD Jul 01 04:16:56 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:56 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD" returned: 0 in 0.744s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:56 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD Jul 01 04:16:56 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:57 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD" returned: 1 in 0.759s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:16:57 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Temporary image 25d1f4e7-a5a4-4447-99a7-9519eb1e85e8 is fetched for user b0f16251918e4f3cb4f9491c4cec5901. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 04:16:57 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f5cacf-9369-488f-aad8-5a7cd8f01ae8]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:16:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:57 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD Jul 01 04:16:57 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:58 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:58 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD Jul 01 04:16:58 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:59 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD" returned: 1 in 0.721s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:16:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:16:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:16:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44128f4-acb6-445f-8d15-4828a7e9a14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95de8dacb40a4889aaadf3f23d2e43c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:16:56Z,use_quota=True,user_id='b0f16251918e4f3cb4f9491c4cec5901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb91d7fd-cc6b-4bfe-a314-c4698f296492),volume_type_id=eb91d7fd-cc6b-4bfe-a314-c4698f296492)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:16:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Creating volume d44128f4-acb6-445f-8d15-4828a7e9a14f {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:16:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:16:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:16:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:16:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:16:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:16:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:16:59 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:16:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:59 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f 1073741824 Jul 01 04:16:59 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:16:59 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Jul 01 04:16:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f 1073741824" returned: 0 in 0.824s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:16:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:16:59 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f Jul 01 04:16:59 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:00 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f" returned: 0 in 0.634s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:17:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:00 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Attempting download of 25d1f4e7-a5a4-4447-99a7-9519eb1e85e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/25d1f4e7-a5a4-4447-99a7-9519eb1e85e8', 'metadata': {}}])) to volume d44128f4-acb6-445f-8d15-4828a7e9a14f. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 04:17:00 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c786719-6b9b-4152-8b9a-57e1e45c90f3]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:17:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_il5hrweq {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:00 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_il5hrweq Jul 01 04:17:00 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:01 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_il5hrweq" returned: 0 in 0.741s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_il5hrweq {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:01 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_il5hrweq Jul 01 04:17:01 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:02 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_il5hrweq" returned: 1 in 0.728s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_il5hrweq' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:17:02 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[636f5884-c45f-4278-aecf-a3cee4e88d19]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:17:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:02 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD Jul 01 04:17:02 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:02 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD" returned: 0 in 0.723s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:02 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD Jul 01 04:17:02 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:03 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD" returned: 1 in 0.744s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:17:03 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] 25d1f4e7-a5a4-4447-99a7-9519eb1e85e8 was raw, converting to raw {{(pid=86177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 04:17:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:03 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f Jul 01 04:17:03 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:04 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f" returned: 0 in 0.715s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:04 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25d1f4e7-a5a4-4447-99a7-9519eb1e85e8_eqnlmpatdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:17:04 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Converted 0.00 MB image at 0.00 MB/s Jul 01 04:17:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:04 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f 1G Jul 01 04:17:04 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:05 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f 1G" returned: 0 in 0.692s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:05 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bfb689-b74e-4aea-9819-6eb71fdd5433]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:17:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:05 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f Jul 01 04:17:05 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-b29c4c68-827a-4418-88f1-dcd5b1771a8e req-6a6ef266-50b2-47ae-9e90-70810e7e4ac2 tempest-TestStampPattern-1782510108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-b29c4c68-827a-4418-88f1-dcd5b1771a8e req-6a6ef266-50b2-47ae-9e90-70810e7e4ac2 tempest-TestStampPattern-1782510108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:05 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[84754020-a1d9-4a60-a96f-e06b849ed734]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:17:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-b29c4c68-827a-4418-88f1-dcd5b1771a8e req-6a6ef266-50b2-47ae-9e90-70810e7e4ac2 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:05 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f Jul 01 04:17:05 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:05 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f" returned: 0 in 0.768s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:05 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f Jul 01 04:17:05 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:06 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-b29c4c68-827a-4418-88f1-dcd5b1771a8e req-6a6ef266-50b2-47ae-9e90-70810e7e4ac2 tempest-TestStampPattern-1782510108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f" returned: 0 in 0.826s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-b29c4c68-827a-4418-88f1-dcd5b1771a8e req-6a6ef266-50b2-47ae-9e90-70810e7e4ac2 tempest-TestStampPattern-1782510108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.845s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-b29c4c68-827a-4418-88f1-dcd5b1771a8e req-6a6ef266-50b2-47ae-9e90-70810e7e4ac2 tempest-TestStampPattern-1782510108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-b50227ac-6dac-4323-8c18-758f6747c72f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3de525f-d93f-4e50-bb42-2469c3896a3c', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:17:06 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-b29c4c68-827a-4418-88f1-dcd5b1771a8e req-6a6ef266-50b2-47ae-9e90-70810e7e4ac2 tempest-TestStampPattern-1782510108 None] attachment_update completed successfully. Jul 01 04:17:06 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f" returned: 1 in 0.863s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:17:06 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Downloaded image 25d1f4e7-a5a4-4447-99a7-9519eb1e85e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/25d1f4e7-a5a4-4447-99a7-9519eb1e85e8', 'metadata': {}}])) to volume d44128f4-acb6-445f-8d15-4828a7e9a14f successfully. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 04:17:06 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Temporary image 25d1f4e7-a5a4-4447-99a7-9519eb1e85e8 for user b0f16251918e4f3cb4f9491c4cec5901 is deleted. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 04:17:06 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Marking volume d44128f4-acb6-445f-8d15-4828a7e9a14f as bootable. {{(pid=86177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 04:17:06 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Copying metadata from image 25d1f4e7-a5a4-4447-99a7-9519eb1e85e8 to d44128f4-acb6-445f-8d15-4828a7e9a14f. {{(pid=86177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 04:17:06 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Creating volume glance metadata for volume d44128f4-acb6-445f-8d15-4828a7e9a14f backed by image 25d1f4e7-a5a4-4447-99a7-9519eb1e85e8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '25d1f4e7-a5a4-4447-99a7-9519eb1e85e8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c0c7fd8688d2bd5da21eb8aca5c5d46a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 04:17:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51cf4ef-706d-4b4c-8170-980e4dca1ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d44128f4-acb6-445f-8d15-4828a7e9a14f', 'volume_size': 1, 'image_id': '25d1f4e7-a5a4-4447-99a7-9519eb1e85e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25d1f4e7-a5a4-4447-99a7-9519eb1e85e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c0c7fd8688d2bd5da21eb8aca5c5d46a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '95de8dacb40a4889aaadf3f23d2e43c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7499b7c40a4f40381bf99ff0e58e4b720094568acb74d1deab21ceeb4d8e242452f594d33b7e4f30f7102afdb58849eb09acee306553701142233cc43cb28278', 'id': '25d1f4e7-a5a4-4447-99a7-9519eb1e85e8', 'created_at': datetime.datetime(2026, 7, 1, 2, 16, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 2, 16, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25d1f4e7-a5a4-4447-99a7-9519eb1e85e8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684dcb62-d325-46ba-ac7a-8f20d35862fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:06 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Volume volume-d44128f4-acb6-445f-8d15-4828a7e9a14f (d44128f4-acb6-445f-8d15-4828a7e9a14f): created successfully Jul 01 04:17:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684dcb62-d325-46ba-ac7a-8f20d35862fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Flow 'volume_create_manager' (51078ab1-a4c3-4f39-a2cb-bf918ca4e81d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:17:06 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-a5da75d2-1e16-4d72-ad95-c81c5faeedd0 tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Created volume successfully. Jul 01 04:17:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Acquiring lock "cinder-d44128f4-acb6-445f-8d15-4828a7e9a14f-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:17:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Lock "cinder-d44128f4-acb6-445f-8d15-4828a7e9a14f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:17:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Acquiring lock "cinder-quobyte-d44128f4-acb6-445f-8d15-4828a7e9a14f" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:17:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Lock "cinder-quobyte-d44128f4-acb6-445f-8d15-4828a7e9a14f" acquired by "delete_volume" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:17:07 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02f2924-39b1-4fd7-84b4-39974af5299c]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:17:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:07 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f Jul 01 04:17:07 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:08 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f" returned: 0 in 0.760s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:08 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f Jul 01 04:17:08 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:08 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f" returned: 1 in 0.734s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:17:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:08 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f Jul 01 04:17:08 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:09 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d44128f4-acb6-445f-8d15-4828a7e9a14f" returned: 0 in 0.657s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Lock "cinder-quobyte-d44128f4-acb6-445f-8d15-4828a7e9a14f" released by "delete_volume" :: held 2.216s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:17:09 devstack cinder-volume[86177]: WARNING cinder.quota [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:17:09 devstack cinder-volume[86177]: WARNING cinder.quota [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 01 04:17:09 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Created reservations ['3d9b8d31-c2dd-42f0-9cd1-e98c21392b46', '4993be5a-6f92-46d1-88e5-672dbfd0ab05', '18b7a49d-4ed8-4390-8d71-2dca3a5d4370', 'b12b33a2-f981-4504-91da-db7e6274be52'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:17:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:17:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:17:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:09 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:17:09 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:10 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.635s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:10 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:17:10 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Deleted volume successfully. Jul 01 04:17:10 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ba7f9c65-25c2-4306-9c35-562e62c3f46b tempest-VolumeAndVolumeTypeFromImageTest-359922968 None] Lock "cinder-d44128f4-acb6-445f-8d15-4828a7e9a14f-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:17:14 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-4d6f353c-0a0a-4c3c-acf6-5c75c96fe4c0 req-c615be73-8701-4945-b49b-788f7eac964a tempest-TestStampPattern-1782510108 None] Terminate volume connection completed successfully. Jul 01 04:17:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-4d6f353c-0a0a-4c3c-acf6-5c75c96fe4c0 req-c615be73-8701-4945-b49b-788f7eac964a tempest-TestStampPattern-1782510108 None] Deleting attachment f3de525f-d93f-4e50-bb42-2469c3896a3c. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Flow 'volume_create_manager' (ae5ba710-1a4e-4230-a808-c028e2bd6efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca365238-60e4-4587-bc09-f898d2c5eb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca365238-60e4-4587-bc09-f898d2c5eb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1251887232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd1c556-a588-4261-aa3f-24b042f0db3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f3ce092c0440059aaac63bd3e07caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:17:15Z,use_quota=True,user_id='7497488357794ae192e5d4d77c35e8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8f194f-7e25-4132-9b13-071ff5e0dcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8f194f-7e25-4132-9b13-071ff5e0dcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c157f8-f53d-42f9-af5d-c1d329e3b5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c157f8-f53d-42f9-af5d-c1d329e3b5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dd1c556-a588-4261-aa3f-24b042f0db3d', 'volume_name': 'volume-5dd1c556-a588-4261-aa3f-24b042f0db3d', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29be89e4-ce5c-4874-b1f5-a0e1cf3c907b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29be89e4-ce5c-4874-b1f5-a0e1cf3c907b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f4edb4-a75b-4486-8d49-c918117bce04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:15 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Volume 5dd1c556-a588-4261-aa3f-24b042f0db3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dd1c556-a588-4261-aa3f-24b042f0db3d', 'volume_size': 1} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1251887232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd1c556-a588-4261-aa3f-24b042f0db3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f3ce092c0440059aaac63bd3e07caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:17:15Z,use_quota=True,user_id='7497488357794ae192e5d4d77c35e8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Creating volume 5dd1c556-a588-4261-aa3f-24b042f0db3d {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:17:15 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5dd1c556-a588-4261-aa3f-24b042f0db3d 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:15 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5dd1c556-a588-4261-aa3f-24b042f0db3d 1073741824 Jul 01 04:17:15 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Flow 'volume_create_manager' (84fb292a-f00e-4d2e-92e6-ce7bf70917e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30613215-acd4-4739-964a-1fdb111befd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30613215-acd4-4739-964a-1fdb111befd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1887660012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee2c2049-8f9a-43d8-8d90-fac97f4f9137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f3ce092c0440059aaac63bd3e07caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:17:15Z,use_quota=True,user_id='7497488357794ae192e5d4d77c35e8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e063d2-e360-4b7b-9670-576298046b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e063d2-e360-4b7b-9670-576298046b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661ab760-c7ee-45f3-a569-0d3363adf768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661ab760-c7ee-45f3-a569-0d3363adf768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee2c2049-8f9a-43d8-8d90-fac97f4f9137', 'volume_name': 'volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281ac403-b8a0-4c91-b7d5-257b46eaba5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281ac403-b8a0-4c91-b7d5-257b46eaba5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba03b4ad-edd3-433c-b53e-6193aa8a0e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:15 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Volume ee2c2049-8f9a-43d8-8d90-fac97f4f9137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137', 'volume_size': 1} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Flow 'volume_create_manager' (f100294a-7f1e-4a45-a878-e76d334aa7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae03b79b-cacf-464d-86c3-776ef9aad8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae03b79b-cacf-464d-86c3-776ef9aad8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1727091438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329b00ba-650a-42e4-9fef-9bd8de53dc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f3ce092c0440059aaac63bd3e07caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:17:16Z,use_quota=True,user_id='7497488357794ae192e5d4d77c35e8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb72abad-6600-4bb5-a5ba-5a11374b17d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb72abad-6600-4bb5-a5ba-5a11374b17d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5432a073-fb5c-4e1f-8d8e-c5fd391e4964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5432a073-fb5c-4e1f-8d8e-c5fd391e4964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '329b00ba-650a-42e4-9fef-9bd8de53dc54', 'volume_name': 'volume-329b00ba-650a-42e4-9fef-9bd8de53dc54', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c00257c-d828-4929-bd92-8f38982d142e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c00257c-d828-4929-bd92-8f38982d142e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ceb124-d41a-4955-baac-193643bf9f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:15 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Volume 329b00ba-650a-42e4-9fef-9bd8de53dc54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-329b00ba-650a-42e4-9fef-9bd8de53dc54', 'volume_size': 1} Jul 01 04:17:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:16 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5dd1c556-a588-4261-aa3f-24b042f0db3d 1073741824" returned: 0 in 0.960s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Flow 'volume_create_manager' (25e1f8b8-4167-4093-99c0-ad231c7cef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f7cf88-72bf-43f0-8c26-cd9e2f58aab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f7cf88-72bf-43f0-8c26-cd9e2f58aab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-608345189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a00899a-d5db-46a6-a1fd-1e4d9f92259c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f3ce092c0440059aaac63bd3e07caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:17:16Z,use_quota=True,user_id='7497488357794ae192e5d4d77c35e8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df38bd3-7cd0-41f4-84d8-900237635733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df38bd3-7cd0-41f4-84d8-900237635733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7718263f-4cbb-4b24-a89d-3849e5f7629f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7718263f-4cbb-4b24-a89d-3849e5f7629f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a00899a-d5db-46a6-a1fd-1e4d9f92259c', 'volume_name': 'volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797c416c-5286-4dcd-bf70-bc457c0633b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797c416c-5286-4dcd-bf70-bc457c0633b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2b7a93-ebc4-4a34-9dea-3e92ec71608e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:16 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Volume 6a00899a-d5db-46a6-a1fd-1e4d9f92259c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c', 'volume_size': 1} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5dd1c556-a588-4261-aa3f-24b042f0db3d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:16 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5dd1c556-a588-4261-aa3f-24b042f0db3d Jul 01 04:17:16 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Flow 'volume_create_manager' (42ad2f30-d468-4632-8ec4-4c4e7786b371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3625d435-3b62-4293-a95a-8868205daed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3625d435-3b62-4293-a95a-8868205daed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1278770688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f3ce092c0440059aaac63bd3e07caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:17:17Z,use_quota=True,user_id='7497488357794ae192e5d4d77c35e8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (767b9a7c-b7e8-42b6-ac62-be1080741ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (767b9a7c-b7e8-42b6-ac62-be1080741ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b048911-de06-4234-88bd-0b72a60a9915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b048911-de06-4234-88bd-0b72a60a9915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b', 'volume_name': 'volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea604800-0a67-4009-93b7-6dc387151450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea604800-0a67-4009-93b7-6dc387151450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cd6206-a964-4020-9ebe-e99053d8aa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:16 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Volume f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b', 'volume_size': 1} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:16 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5dd1c556-a588-4261-aa3f-24b042f0db3d" returned: 0 in 0.659s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1887660012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee2c2049-8f9a-43d8-8d90-fac97f4f9137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f3ce092c0440059aaac63bd3e07caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:17:15Z,use_quota=True,user_id='7497488357794ae192e5d4d77c35e8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Creating volume ee2c2049-8f9a-43d8-8d90-fac97f4f9137 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:17:17 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:17 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137 1073741824 Jul 01 04:17:17 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f4edb4-a75b-4486-8d49-c918117bce04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dd1c556-a588-4261-aa3f-24b042f0db3d', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce8034d-fd8c-4098-a0a0-a2beb172b81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:17 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Volume volume-5dd1c556-a588-4261-aa3f-24b042f0db3d (5dd1c556-a588-4261-aa3f-24b042f0db3d): created successfully Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce8034d-fd8c-4098-a0a0-a2beb172b81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Flow 'volume_create_manager' (ae5ba710-1a4e-4230-a808-c028e2bd6efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:17:17 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-eaa6d993-c903-4967-a631-22b5b19278cc tempest-CreateVolumesFromImageTest-1273341619 None] Created volume successfully. Jul 01 04:17:17 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137 1073741824" returned: 0 in 0.801s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:17 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137 Jul 01 04:17:17 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:18 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137" returned: 0 in 0.635s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.549s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1727091438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329b00ba-650a-42e4-9fef-9bd8de53dc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f3ce092c0440059aaac63bd3e07caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:17:16Z,use_quota=True,user_id='7497488357794ae192e5d4d77c35e8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Creating volume 329b00ba-650a-42e4-9fef-9bd8de53dc54 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:17:18 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-329b00ba-650a-42e4-9fef-9bd8de53dc54 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba03b4ad-edd3-433c-b53e-6193aa8a0e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:18 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-329b00ba-650a-42e4-9fef-9bd8de53dc54 1073741824 Jul 01 04:17:18 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f796016-8a9f-4670-b181-c9a5f06d01e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:18 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Volume volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137 (ee2c2049-8f9a-43d8-8d90-fac97f4f9137): created successfully Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f796016-8a9f-4670-b181-c9a5f06d01e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Flow 'volume_create_manager' (84fb292a-f00e-4d2e-92e6-ce7bf70917e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:17:18 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-58a780d0-b53f-4197-b6d5-ff02c9148610 tempest-CreateVolumesFromImageTest-1273341619 None] Created volume successfully. Jul 01 04:17:19 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-329b00ba-650a-42e4-9fef-9bd8de53dc54 1073741824" returned: 0 in 0.801s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-329b00ba-650a-42e4-9fef-9bd8de53dc54 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:19 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-329b00ba-650a-42e4-9fef-9bd8de53dc54 Jul 01 04:17:19 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:19 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-329b00ba-650a-42e4-9fef-9bd8de53dc54" returned: 0 in 0.640s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:17:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.627s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-608345189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a00899a-d5db-46a6-a1fd-1e4d9f92259c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f3ce092c0440059aaac63bd3e07caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:17:16Z,use_quota=True,user_id='7497488357794ae192e5d4d77c35e8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:17:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Creating volume 6a00899a-d5db-46a6-a1fd-1e4d9f92259c {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:17:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:17:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:17:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:17:19 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:17:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:20 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c 1073741824 Jul 01 04:17:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ceb124-d41a-4955-baac-193643bf9f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-329b00ba-650a-42e4-9fef-9bd8de53dc54', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:20 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26901fb-a651-42b0-8dea-0d64b84cc98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:20 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Volume volume-329b00ba-650a-42e4-9fef-9bd8de53dc54 (329b00ba-650a-42e4-9fef-9bd8de53dc54): created successfully Jul 01 04:17:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26901fb-a651-42b0-8dea-0d64b84cc98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:20 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Flow 'volume_create_manager' (f100294a-7f1e-4a45-a878-e76d334aa7fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:17:20 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f76f7912-f540-4d96-830d-138400f52362 tempest-CreateVolumesFromImageTest-1273341619 None] Created volume successfully. Jul 01 04:17:20 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c 1073741824" returned: 0 in 0.795s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:20 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c Jul 01 04:17:20 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:21 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c" returned: 0 in 0.620s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.754s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1278770688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f3ce092c0440059aaac63bd3e07caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:17:17Z,use_quota=True,user_id='7497488357794ae192e5d4d77c35e8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Creating volume f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:17:21 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2b7a93-ebc4-4a34-9dea-3e92ec71608e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:21 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b 1073741824 Jul 01 04:17:21 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2fb908a-b1cf-4bd1-8ee5-8ab835bed7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:21 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Volume volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c (6a00899a-d5db-46a6-a1fd-1e4d9f92259c): created successfully Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2fb908a-b1cf-4bd1-8ee5-8ab835bed7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:21 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Flow 'volume_create_manager' (25e1f8b8-4167-4093-99c0-ad231c7cef10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:17:21 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-485e5704-768e-44ea-a345-94d589f197bb tempest-CreateVolumesFromImageTest-1273341619 None] Created volume successfully. Jul 01 04:17:22 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b 1073741824" returned: 0 in 0.795s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:22 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b Jul 01 04:17:22 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:22 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b" returned: 0 in 0.638s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:17:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.102s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cd6206-a964-4020-9ebe-e99053d8aa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a76929-2189-4781-ba3a-081cb9d366a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] Creating offline snapshot 8585fddd-5be3-4352-b32f-632591cdfce2 of volume b50227ac-6dac-4323-8c18-758f6747c72f {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:17:22 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Volume volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b (f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b): created successfully Jul 01 04:17:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a76929-2189-4781-ba3a-081cb9d366a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:22 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Flow 'volume_create_manager' (42ad2f30-d468-4632-8ec4-4c4e7786b371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:17:22 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c513c001-bc84-4b22-aea8-f0e9d9eb143b]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:17:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:22 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-7b90c6bd-a59d-4cde-b66c-38e6532ea68f tempest-CreateVolumesFromImageTest-1273341619 None] Created volume successfully. Jul 01 04:17:23 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f Jul 01 04:17:23 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "cinder-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:17:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:17:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "cinder-quobyte-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:17:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-quobyte-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b" acquired by "delete_volume" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:17:23 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9778284b-bb42-46f7-80df-6097e03825b6]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:17:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:23 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b Jul 01 04:17:23 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:23 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f" returned: 0 in 0.797s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:23 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 1G Jul 01 04:17:23 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:23 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b" returned: 0 in 0.750s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:24 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b Jul 01 04:17:24 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:24 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 1G" returned: 0 in 0.773s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50227ac-6dac-4323-8c18-758f6747c72f -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:24 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:17:24 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:24 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50227ac-6dac-4323-8c18-758f6747c72f -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 Jul 01 04:17:24 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:24 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b" returned: 0 in 0.718s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-quobyte-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b" released by "delete_volume" :: held 1.518s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Created reservations ['cd89804a-487a-4cf5-961d-4cd9681a739d', 'a290130e-adb3-4bc2-ba70-40ea3b0f48c2', '1aa07688-bc36-44bd-8ef6-10cb08bd63d9', '5ce7beda-4b5e-4dde-9cb8-9a4749ba553a'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:24 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:17:24 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:25 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.699s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:17:25 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50227ac-6dac-4323-8c18-758f6747c72f -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2" returned: 0 in 0.741s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:25 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 is being set with open permissions: ugo+rw Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:25 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 Jul 01 04:17:25 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "cinder-6a00899a-d5db-46a6-a1fd-1e4d9f92259c-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-6a00899a-d5db-46a6-a1fd-1e4d9f92259c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "cinder-quobyte-6a00899a-d5db-46a6-a1fd-1e4d9f92259c" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-quobyte-6a00899a-d5db-46a6-a1fd-1e4d9f92259c" acquired by "delete_volume" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b508552f-ad2f-4889-b7d3-4bb4456ee047]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:25 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.704s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:17:25 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Deleted volume successfully. Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5f49f446-d37e-4623-9c5d-e62b7a2846f9 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-f0d0b5dc-2fce-4a42-bc7f-e74f48ae102b-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:17:25 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c Jul 01 04:17:25 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:25 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2" returned: 0 in 0.699s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:26 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.info Jul 01 04:17:26 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:26 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c" returned: 0 in 0.802s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:26 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c Jul 01 04:17:26 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:26 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.info" returned: 0 in 0.659s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:26 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.info is being set with open permissions: ugo+rw Jul 01 04:17:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:26 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.info Jul 01 04:17:26 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:26 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6a00899a-d5db-46a6-a1fd-1e4d9f92259c" returned: 0 in 0.670s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-quobyte-6a00899a-d5db-46a6-a1fd-1e4d9f92259c" released by "delete_volume" :: held 1.518s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Created reservations ['82fc9c15-3e71-406c-ae3b-dce8513daf1b', '04e32cb2-152f-49c1-b332-87e433bc14f7', '4a2f3a1a-208c-4ba2-8d0f-757217a3bce0', 'b74b5cc2-75f5-448b-86b3-292943e81821'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:27 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:17:27 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:27 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.info" returned: 0 in 0.665s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.459s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:27 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-95566ba2-0555-4928-83a5-88c4d115ede9 tempest-TestStampPattern-1782510108 None] Create snapshot completed successfully Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "cinder-329b00ba-650a-42e4-9fef-9bd8de53dc54-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-329b00ba-650a-42e4-9fef-9bd8de53dc54-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "cinder-quobyte-329b00ba-650a-42e4-9fef-9bd8de53dc54" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-quobyte-329b00ba-650a-42e4-9fef-9bd8de53dc54" acquired by "delete_volume" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6179b47a-fbab-46b2-aa76-4c8ff0715438]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-329b00ba-650a-42e4-9fef-9bd8de53dc54 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:27 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.678s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:17:27 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Deleted volume successfully. Jul 01 04:17:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e5693929-f2ec-4919-83b7-351661e50036 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-6a00899a-d5db-46a6-a1fd-1e4d9f92259c-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:17:27 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-329b00ba-650a-42e4-9fef-9bd8de53dc54 Jul 01 04:17:27 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:28 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-329b00ba-650a-42e4-9fef-9bd8de53dc54" returned: 0 in 0.773s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-329b00ba-650a-42e4-9fef-9bd8de53dc54 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:28 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-329b00ba-650a-42e4-9fef-9bd8de53dc54 Jul 01 04:17:28 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:29 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-329b00ba-650a-42e4-9fef-9bd8de53dc54" returned: 0 in 0.683s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-quobyte-329b00ba-650a-42e4-9fef-9bd8de53dc54" released by "delete_volume" :: held 1.496s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Created reservations ['e5dcb27d-6898-43d4-a055-1ec7859a0d57', 'f0f38288-f216-4a1b-b8c2-8d80190d33e5', '02eaee6d-e04b-447e-9b22-e515f9920a6a', 'ebfdd3e2-b04e-48a3-b17c-44891f7a16d9'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:29 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:17:29 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "cinder-ee2c2049-8f9a-43d8-8d90-fac97f4f9137-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-ee2c2049-8f9a-43d8-8d90-fac97f4f9137-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "cinder-quobyte-ee2c2049-8f9a-43d8-8d90-fac97f4f9137" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-quobyte-ee2c2049-8f9a-43d8-8d90-fac97f4f9137" acquired by "delete_volume" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9282cf9e-9320-4e7a-9010-0b036d9e6d8c]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:29 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.671s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:29 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:17:29 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Deleted volume successfully. Jul 01 04:17:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-86058eda-4984-4e8c-a117-6780e3d49ea1 tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-329b00ba-650a-42e4-9fef-9bd8de53dc54-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:17:30 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137 Jul 01 04:17:30 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:30 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137" returned: 0 in 0.755s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:30 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137 Jul 01 04:17:30 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:31 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-ee2c2049-8f9a-43d8-8d90-fac97f4f9137" returned: 0 in 0.664s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:31 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-quobyte-ee2c2049-8f9a-43d8-8d90-fac97f4f9137" released by "delete_volume" :: held 1.463s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:17:31 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Created reservations ['6818eef1-65ce-4395-a053-fe3db107fa8e', 'ab2a98ba-a1a7-43bb-aef5-6f72c3392a11', '39d05915-e169-4fae-9746-dd1773ccbae2', '76fab5e5-ca12-40b4-9828-d11ea1c1a27a'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:17:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:17:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:17:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:31 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:17:31 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "cinder-5dd1c556-a588-4261-aa3f-24b042f0db3d-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:17:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-5dd1c556-a588-4261-aa3f-24b042f0db3d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:17:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "cinder-quobyte-5dd1c556-a588-4261-aa3f-24b042f0db3d" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:17:32 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.665s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:32 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:17:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-quobyte-5dd1c556-a588-4261-aa3f-24b042f0db3d" acquired by "delete_volume" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:17:32 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Deleted volume successfully. Jul 01 04:17:32 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62a53dd-07f7-4fd4-b452-98ac201c61a8]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:17:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5dd1c556-a588-4261-aa3f-24b042f0db3d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-240b576d-0817-4e67-b71a-d59dda0b8a6e tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-ee2c2049-8f9a-43d8-8d90-fac97f4f9137-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:17:32 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5dd1c556-a588-4261-aa3f-24b042f0db3d Jul 01 04:17:32 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:33 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5dd1c556-a588-4261-aa3f-24b042f0db3d" returned: 0 in 0.802s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5dd1c556-a588-4261-aa3f-24b042f0db3d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:33 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5dd1c556-a588-4261-aa3f-24b042f0db3d Jul 01 04:17:33 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:33 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-5dd1c556-a588-4261-aa3f-24b042f0db3d" returned: 0 in 0.674s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:33 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-quobyte-5dd1c556-a588-4261-aa3f-24b042f0db3d" released by "delete_volume" :: held 1.519s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:17:33 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Created reservations ['37aed389-9a29-4f4e-b328-bf7837a014e1', '6e04bd42-2073-410d-9ca6-b24444f95a43', '21de545b-4b7f-4ff8-8ca2-73f946fa0ef1', '591513a4-c9f0-4d94-94e5-49f0d5c256e2'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:17:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:33 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:17:33 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:17:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:33 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:17:33 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:34 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.665s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:34 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:17:34 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Deleted volume successfully. Jul 01 04:17:34 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0e6a356a-a498-468c-abfc-6271c178e0ab tempest-CreateVolumesFromImageTest-1273341619 None] Lock "cinder-5dd1c556-a588-4261-aa3f-24b042f0db3d-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Flow 'volume_create_manager' (c62a3f0f-adda-48a6-8fb5-ed3a2dd79ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05d7479-9eb8-4b31-b7ed-ae4ce357d62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05d7479-9eb8-4b31-b7ed-ae4ce357d62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1481288402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bf1a6c-5b8a-458e-894a-b2d4321a9144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79aa4937dd204092a7451a9b4e6bcc4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8585fddd-5be3-4352-b32f-632591cdfce2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:17:38Z,use_quota=True,user_id='2897ce6d688c43519a40bd9193b54122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ac6379-a2ba-43ff-9fef-e48063e844dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ac6379-a2ba-43ff-9fef-e48063e844dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd60f84-2420-478a-8778-04d8d4104d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd60f84-2420-478a-8778-04d8d4104d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '93bf1a6c-5b8a-458e-894a-b2d4321a9144', 'volume_name': 'volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144', 'volume_size': 1, 'snapshot_id': '8585fddd-5be3-4352-b32f-632591cdfce2'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d4b9b0-41bd-409b-b4a2-8f1061b73bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d4b9b0-41bd-409b-b4a2-8f1061b73bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69a9afb-afe6-4002-ab77-297c7c3e47d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:38 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Volume 93bf1a6c-5b8a-458e-894a-b2d4321a9144: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144', 'volume_size': 1, 'snapshot_id': '8585fddd-5be3-4352-b32f-632591cdfce2'} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Acquiring lock "cinder-quobyte-8585fddd-5be3-4352-b32f-632591cdfce2-93bf1a6c-5b8a-458e-894a-b2d4321a9144" by "_create_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Lock "cinder-quobyte-8585fddd-5be3-4352-b32f-632591cdfce2-93bf1a6c-5b8a-458e-894a-b2d4321a9144" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Creating volume 93bf1a6c-5b8a-458e-894a-b2d4321a9144 from snapshot 8585fddd-5be3-4352-b32f-632591cdfce2 {{(pid=86177) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Acquiring lock "cinder-quobyte-93bf1a6c-5b8a-458e-894a-b2d4321a9144" by "_copy_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Lock "cinder-quobyte-93bf1a6c-5b8a-458e-894a-b2d4321a9144" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] snapshot: 8585fddd-5be3-4352-b32f-632591cdfce2, volume: 93bf1a6c-5b8a-458e-894a-b2d4321a9144, {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[89309d34-7f3d-4dc8-b696-db742480411f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:17:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:38 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 Jul 01 04:17:38 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:39 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2" returned: 0 in 0.776s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b50227ac-6dac-4323-8c18-758f6747c72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:17:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 04:17:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Creating direct copy from snapshot {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 04:17:39 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2dd3b7-724c-4122-a6d2-aad21926abbf]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:17:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:39 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f Jul 01 04:17:39 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:39 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f" returned: 0 in 0.788s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:39 devstack cinder-volume[86177]: DEBUG cinder.utils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Path /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144 not found in is_blk_device check {{(pid=86177) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 04:17:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:39 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144 Jul 01 04:17:39 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:44 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144" returned: 0 in 4.904s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:44 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[934521e3-dbee-4896-be4a-b679f214a374]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:17:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:44 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f Jul 01 04:17:44 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:45 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f" returned: 0 in 0.987s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:45 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Image conversion details: src /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:17:45 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Converted 1024.00 MB image at 208.74 MB/s Jul 01 04:17:45 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144 is being set with open permissions: ugo+rw Jul 01 04:17:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:17:45 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144 Jul 01 04:17:45 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:17:46 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Jul 01 04:17:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144" returned: 0 in 0.719s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:17:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Lock "cinder-quobyte-93bf1a6c-5b8a-458e-894a-b2d4321a9144" released by "_copy_volume_from_snapshot" :: held 8.281s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:17:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Lock "cinder-quobyte-8585fddd-5be3-4352-b32f-632591cdfce2-93bf1a6c-5b8a-458e-894a-b2d4321a9144" released by "_create_volume_from_snapshot" :: held 8.315s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:17:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.332s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:17:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69a9afb-afe6-4002-ab77-297c7c3e47d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144', 'volume_size': 1, 'snapshot_id': '8585fddd-5be3-4352-b32f-632591cdfce2'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0382f8fc-bb0c-463b-b222-d86fefbe5bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:17:46 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Volume volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144 (93bf1a6c-5b8a-458e-894a-b2d4321a9144): created successfully Jul 01 04:17:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0382f8fc-bb0c-463b-b222-d86fefbe5bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:17:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Flow 'volume_create_manager' (c62a3f0f-adda-48a6-8fb5-ed3a2dd79ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:17:46 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-67be17ab-456f-47a0-916e-2c92d9b43763 tempest-TestStampPattern-1782510108 None] Created volume successfully. Jul 01 04:17:56 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=59,cinder:INSERT=23,cinder:UPDATE=79,cinder:DELETE=5 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:17:56 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=63,cinder:UPDATE=67,cinder:INSERT=18,cinder:DELETE=9 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:18:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:18:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:18:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:18:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:18:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:18:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:18:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:18:24 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:18:24 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:18:25 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Jul 01 04:18:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.644s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:18:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:18:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:18:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:18:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:18:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-13a9b701-4b4d-45c6-85dd-00f4a95041df req-807fc846-fdb7-4e4c-9fc3-d20b829cbf02 tempest-TestStampPattern-1782510108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:18:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-13a9b701-4b4d-45c6-85dd-00f4a95041df req-807fc846-fdb7-4e4c-9fc3-d20b829cbf02 tempest-TestStampPattern-1782510108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:18:35 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b9e192-af6d-4976-aef4-004a6651df83]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:18:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-13a9b701-4b4d-45c6-85dd-00f4a95041df req-807fc846-fdb7-4e4c-9fc3-d20b829cbf02 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:18:35 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144 Jul 01 04:18:35 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:18:36 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Jul 01 04:18:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [req-13a9b701-4b4d-45c6-85dd-00f4a95041df req-807fc846-fdb7-4e4c-9fc3-d20b829cbf02 tempest-TestStampPattern-1782510108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144" returned: 0 in 0.733s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:18:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [req-13a9b701-4b4d-45c6-85dd-00f4a95041df req-807fc846-fdb7-4e4c-9fc3-d20b829cbf02 tempest-TestStampPattern-1782510108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.751s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:18:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-13a9b701-4b4d-45c6-85dd-00f4a95041df req-807fc846-fdb7-4e4c-9fc3-d20b829cbf02 tempest-TestStampPattern-1782510108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661', 'name': 'volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e014c40a-08da-43b4-9564-e0973d458506', 'enforce_multipath': True} {{(pid=86177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 01 04:18:36 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-13a9b701-4b4d-45c6-85dd-00f4a95041df req-807fc846-fdb7-4e4c-9fc3-d20b829cbf02 tempest-TestStampPattern-1782510108 None] attachment_update completed successfully. Jul 01 04:18:42 devstack cinder-volume[86177]: INFO cinder.volume.manager [req-d0b72abb-65d6-4fc1-9ee9-f5b96d33d6f1 req-c0e225bc-c0a6-455b-ac12-a3e8a1b40ac8 tempest-TestStampPattern-1782510108 None] Terminate volume connection completed successfully. Jul 01 04:18:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [req-d0b72abb-65d6-4fc1-9ee9-f5b96d33d6f1 req-c0e225bc-c0a6-455b-ac12-a3e8a1b40ac8 tempest-TestStampPattern-1782510108 None] Deleting attachment e014c40a-08da-43b4-9564-e0973d458506. {{(pid=86177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 01 04:18:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Acquiring lock "cinder-93bf1a6c-5b8a-458e-894a-b2d4321a9144-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:18:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Lock "cinder-93bf1a6c-5b8a-458e-894a-b2d4321a9144-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:18:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Acquiring lock "cinder-quobyte-93bf1a6c-5b8a-458e-894a-b2d4321a9144" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:18:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Lock "cinder-quobyte-93bf1a6c-5b8a-458e-894a-b2d4321a9144" acquired by "delete_volume" :: waited 0.014s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:18:51 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd1c356-e2bc-406d-a9cf-6f49af6d0f1b]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:18:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:18:52 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144 Jul 01 04:18:52 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:18:52 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jul 01 04:18:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144" returned: 0 in 0.738s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:18:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:18:52 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144 Jul 01 04:18:52 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:18:53 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jul 01 04:18:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-93bf1a6c-5b8a-458e-894a-b2d4321a9144" returned: 0 in 0.632s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:18:53 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Lock "cinder-quobyte-93bf1a6c-5b8a-458e-894a-b2d4321a9144" released by "delete_volume" :: held 1.404s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:18:53 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Created reservations ['d1beecc2-abe5-49f7-8244-1d6ffbb33674', '33d0a8b6-7eb8-49d2-817a-ecb59eccb2dd', 'bd6144a5-eb33-4593-a31c-0d1dc7eb6299', '030ac168-02c5-4d07-8818-2f5062ecf60d'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:18:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:18:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:18:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:18:53 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:18:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:18:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:18:53 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:18:53 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:18:54 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Jul 01 04:18:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.641s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:18:54 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:18:54 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Deleted volume successfully. Jul 01 04:18:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-cfc06beb-bc92-4964-bcee-b5bef550ea44 tempest-TestStampPattern-1782510108 None] Lock "cinder-93bf1a6c-5b8a-458e-894a-b2d4321a9144-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:18:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Acquiring lock "cinder-8585fddd-5be3-4352-b32f-632591cdfce2-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:18:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Lock "cinder-8585fddd-5be3-4352-b32f-632591cdfce2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:18:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Acquiring lock "cinder-quobyte-b50227ac-6dac-4323-8c18-758f6747c72f" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:18:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Lock "cinder-quobyte-b50227ac-6dac-4323-8c18-758f6747c72f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:18:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Acquiring lock "cinder-quobyte-8585fddd-5be3-4352-b32f-632591cdfce2" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:18:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Lock "cinder-quobyte-8585fddd-5be3-4352-b32f-632591cdfce2" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:18:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Deleting offline snapshot 8585fddd-5be3-4352-b32f-632591cdfce2 of volume b50227ac-6dac-4323-8c18-758f6747c72f {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:18:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] snapshot_file for this snap is: volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:18:54 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dcbf55-2689-4d7a-8cc5-2c7ab520dddc]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:18:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:18:54 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 Jul 01 04:18:54 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:18:55 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Jul 01 04:18:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2" returned: 0 in 0.756s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:18:55 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b50227ac-6dac-4323-8c18-758f6747c72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:18:55 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb0fb26-b1a8-4caf-9212-27dff4e893f7]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:18:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:18:55 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f Jul 01 04:18:55 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:18:55 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Jul 01 04:18:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f" returned: 0 in 0.748s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:18:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:18:55 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 Jul 01 04:18:55 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:18:56 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Jul 01 04:18:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2" returned: 0 in 0.731s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:18:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:18:56 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2 Jul 01 04:18:56 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:18:57 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jul 01 04:18:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f.8585fddd-5be3-4352-b32f-632591cdfce2" returned: 0 in 0.643s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:18:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Lock "cinder-quobyte-8585fddd-5be3-4352-b32f-632591cdfce2" released by "_delete_snapshot" :: held 2.966s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:18:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Lock "cinder-quobyte-b50227ac-6dac-4323-8c18-758f6747c72f" released by "delete_snapshot" :: held 2.986s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:18:57 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Created reservations ['97fd4c80-76be-4a42-aa97-df03d0d39f4e', 'bc7c2235-bd0a-44cf-ac24-af7c67d85c9e', 'ed4102f5-321e-4c21-ba64-dfc4b0322823', '8c55b53b-512c-4888-a850-acb905534437'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:18:57 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Delete snapshot completed successfully. Jul 01 04:18:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0da6a8f3-e5f0-4788-a31f-7ee45533fb87 tempest-TestStampPattern-1782510108 None] Lock "cinder-8585fddd-5be3-4352-b32f-632591cdfce2-delete_snapshot" released by "delete_snapshot" :: held 3.111s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Acquiring lock "cinder-b50227ac-6dac-4323-8c18-758f6747c72f-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Lock "cinder-b50227ac-6dac-4323-8c18-758f6747c72f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Acquiring lock "cinder-quobyte-b50227ac-6dac-4323-8c18-758f6747c72f" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Lock "cinder-quobyte-b50227ac-6dac-4323-8c18-758f6747c72f" acquired by "delete_volume" :: waited 0.015s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:04 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bf517c-973e-42a1-90f5-357015ae9d5e]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:19:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:04 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f Jul 01 04:19:04 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:05 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f" returned: 0 in 0.766s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:05 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f Jul 01 04:19:05 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:06 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b50227ac-6dac-4323-8c18-758f6747c72f" returned: 0 in 0.647s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Lock "cinder-quobyte-b50227ac-6dac-4323-8c18-758f6747c72f" released by "delete_volume" :: held 1.463s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:06 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Created reservations ['d837d527-9cb4-405a-aef6-1bfb6691d349', '6287241a-b2c5-49a9-b8b0-853de5ff972a', '2909ed19-3d52-49f3-81e4-4ceff156cabd', 'b08c6cee-393a-405e-a324-2f5c3d35900c'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:19:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:19:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:19:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:06 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:19:06 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:06 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.660s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:06 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:19:06 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Deleted volume successfully. Jul 01 04:19:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-73817c5d-76d6-4279-b412-f3a1cf63f63b tempest-TestStampPattern-1782510108 None] Lock "cinder-b50227ac-6dac-4323-8c18-758f6747c72f-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:16 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=23,cinder:UPDATE=22,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:19:16 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=22,cinder:UPDATE=25,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Flow 'volume_create_manager' (7047d976-d785-4e71-9d79-8f24758e5b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0169b2d-fef2-4243-99fc-710579af5892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0169b2d-fef2-4243-99fc-710579af5892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1680633391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfa5f01-8482-4a15-94a5-62ddd6ca1285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571c56ccc86a4ad387e58a110b4fbade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:19:17Z,use_quota=True,user_id='6ac09932f0124eb08e9e627966c31e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5852b6-d7c8-4dc6-aa7a-d1539f96f837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5852b6-d7c8-4dc6-aa7a-d1539f96f837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6401ee5-9db2-4857-868a-c6954ae607b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6401ee5-9db2-4857-868a-c6954ae607b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bfa5f01-8482-4a15-94a5-62ddd6ca1285', 'volume_name': 'volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45d9a05-67f0-4510-b178-b77750a8a626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45d9a05-67f0-4510-b178-b77750a8a626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (825d89e7-380d-4e2c-a30c-4a63aebe9a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:17 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume 1bfa5f01-8482-4a15-94a5-62ddd6ca1285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285', 'volume_size': 1} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1680633391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfa5f01-8482-4a15-94a5-62ddd6ca1285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571c56ccc86a4ad387e58a110b4fbade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:19:17Z,use_quota=True,user_id='6ac09932f0124eb08e9e627966c31e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Creating volume 1bfa5f01-8482-4a15-94a5-62ddd6ca1285 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:19:17 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:19:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:17 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 1073741824 Jul 01 04:19:17 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:18 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 1073741824" returned: 0 in 0.807s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:18 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 Jul 01 04:19:18 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:18 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285" returned: 0 in 0.624s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:19:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (825d89e7-380d-4e2c-a30c-4a63aebe9a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ad7672-9a4b-4604-a76d-63526f08c60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:18 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 (1bfa5f01-8482-4a15-94a5-62ddd6ca1285): created successfully Jul 01 04:19:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ad7672-9a4b-4604-a76d-63526f08c60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Flow 'volume_create_manager' (7047d976-d785-4e71-9d79-8f24758e5b44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:19:18 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-7da9408f-962d-46c9-ad7f-367754b49841 tempest-CreateVolumesFromSnapshotTest-541702497 None] Created volume successfully. Jul 01 04:19:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] Creating offline snapshot 4056225e-5f58-4c3f-acf9-948bbe108776 of volume 1bfa5f01-8482-4a15-94a5-62ddd6ca1285 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:19:19 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b25abb5-226a-4400-879f-c338038a0aa3]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:19:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:19 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 Jul 01 04:19:19 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:20 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285" returned: 0 in 0.735s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:20 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776 1G Jul 01 04:19:20 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:21 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776 1G" returned: 0 in 0.759s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:21 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776 Jul 01 04:19:21 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:21 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776" returned: 0 in 0.671s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:21 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776 is being set with open permissions: ugo+rw Jul 01 04:19:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:21 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776 Jul 01 04:19:21 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:22 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776" returned: 0 in 0.615s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:22 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.info Jul 01 04:19:22 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:23 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.info" returned: 0 in 0.633s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:23 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.info is being set with open permissions: ugo+rw Jul 01 04:19:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:23 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.info Jul 01 04:19:23 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:23 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.info" returned: 0 in 0.624s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.121s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:23 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-89dd2326-301d-417a-823c-f19ab6e70a1b tempest-CreateVolumesFromSnapshotTest-541702497 None] Create snapshot completed successfully Jul 01 04:19:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:19:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:19:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:19:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:24 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:19:24 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:25 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.651s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Flow 'volume_create_manager' (b522aaff-b77a-494d-a1d2-bf89556c35e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ad2ea6-5b91-45c0-93e5-f461aaccb66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ad2ea6-5b91-45c0-93e5-f461aaccb66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-978237611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0b9649-da92-4da1-bb52-5e997cc1cd68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571c56ccc86a4ad387e58a110b4fbade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:19:25Z,use_quota=True,user_id='6ac09932f0124eb08e9e627966c31e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11490d1-a92f-4294-8005-38ff50671b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11490d1-a92f-4294-8005-38ff50671b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb751b6-ddbf-4e02-b24e-584150d1802c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb751b6-ddbf-4e02-b24e-584150d1802c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0b9649-da92-4da1-bb52-5e997cc1cd68', 'volume_name': 'volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcaec153-ca61-450e-b3aa-365c1126f2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcaec153-ca61-450e-b3aa-365c1126f2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4117c41-e02d-4767-ab1d-dc8cdfaedea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:25 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume 6b0b9649-da92-4da1-bb52-5e997cc1cd68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68', 'volume_size': 1} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-978237611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0b9649-da92-4da1-bb52-5e997cc1cd68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571c56ccc86a4ad387e58a110b4fbade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:19:25Z,use_quota=True,user_id='6ac09932f0124eb08e9e627966c31e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Creating volume 6b0b9649-da92-4da1-bb52-5e997cc1cd68 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:19:25 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:25 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68 1073741824 Jul 01 04:19:25 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Flow 'volume_create_manager' (c1a31f27-eee9-4089-8153-e6adee693625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a56f0e-2349-4262-8636-2e20faaa321f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a56f0e-2349-4262-8636-2e20faaa321f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040580861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92dedf9-f21b-4de5-aa6c-beb780126db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571c56ccc86a4ad387e58a110b4fbade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:19:26Z,use_quota=True,user_id='6ac09932f0124eb08e9e627966c31e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d3c0f3-f3bd-4494-8d15-5f2aa5007d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d3c0f3-f3bd-4494-8d15-5f2aa5007d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b282cd-19ed-43b5-9051-5c097fd6342d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b282cd-19ed-43b5-9051-5c097fd6342d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd92dedf9-f21b-4de5-aa6c-beb780126db5', 'volume_name': 'volume-d92dedf9-f21b-4de5-aa6c-beb780126db5', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e301a7-9f3e-4b58-abae-40db2a917ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e301a7-9f3e-4b58-abae-40db2a917ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d40d7f-c171-404c-be8b-609983e9e235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:25 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume d92dedf9-f21b-4de5-aa6c-beb780126db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d92dedf9-f21b-4de5-aa6c-beb780126db5', 'volume_size': 1} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Flow 'volume_create_manager' (0d9d3aa4-ce2e-43bf-aa01-937eb91ddd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3ea6a3-ac27-41f7-8cfe-38ca022ef4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3ea6a3-ac27-41f7-8cfe-38ca022ef4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-151657079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38a517b-3196-499e-a6e2-4b01dbc9b20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571c56ccc86a4ad387e58a110b4fbade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:19:26Z,use_quota=True,user_id='6ac09932f0124eb08e9e627966c31e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0eb7353-6e74-483b-abb3-4153f9944d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0eb7353-6e74-483b-abb3-4153f9944d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe82bf0-de5f-44d2-99df-330e175150ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe82bf0-de5f-44d2-99df-330e175150ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e38a517b-3196-499e-a6e2-4b01dbc9b20f', 'volume_name': 'volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafe66b1-03db-4c46-96e1-dedac7896496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafe66b1-03db-4c46-96e1-dedac7896496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a58626-8f79-4f04-8c2b-47b3bc7c090f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:26 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume e38a517b-3196-499e-a6e2-4b01dbc9b20f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f', 'volume_size': 1} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:26 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68 1073741824" returned: 0 in 0.910s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:26 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68 Jul 01 04:19:26 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Flow 'volume_create_manager' (2a14e2f1-f4e9-4ef7-988e-b2bfea903044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742a91f7-3eb1-4492-9e00-5c4cbc42d173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742a91f7-3eb1-4492-9e00-5c4cbc42d173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-656673738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27abb36f-7867-4923-a039-d3b769670845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571c56ccc86a4ad387e58a110b4fbade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:19:26Z,use_quota=True,user_id='6ac09932f0124eb08e9e627966c31e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbb40fc-9534-4487-b0e8-a86561492590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbb40fc-9534-4487-b0e8-a86561492590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9663d70-9c06-4887-a184-7758879ebed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9663d70-9c06-4887-a184-7758879ebed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27abb36f-7867-4923-a039-d3b769670845', 'volume_name': 'volume-27abb36f-7867-4923-a039-d3b769670845', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8859a52d-2fa6-416e-8e20-6ea30b5d2485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8859a52d-2fa6-416e-8e20-6ea30b5d2485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49723dbe-9ad4-4836-8429-259d5693626b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:26 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume 27abb36f-7867-4923-a039-d3b769670845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27abb36f-7867-4923-a039-d3b769670845', 'volume_size': 1} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Flow 'volume_create_manager' (badef333-537a-49f3-a727-b8def1d7b93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299fd9a5-610d-4c87-8a8e-3919133703ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299fd9a5-610d-4c87-8a8e-3919133703ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-891887934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482ae5e7-5ca7-4f76-b3fd-4ad4647acd91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571c56ccc86a4ad387e58a110b4fbade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:19:27Z,use_quota=True,user_id='6ac09932f0124eb08e9e627966c31e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ce1dc2-a919-4763-87cd-27e698e3f8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ce1dc2-a919-4763-87cd-27e698e3f8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c731f32-67bc-43e4-afc7-9e9e1fbc5b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c731f32-67bc-43e4-afc7-9e9e1fbc5b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482ae5e7-5ca7-4f76-b3fd-4ad4647acd91', 'volume_name': 'volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b421f11-c971-4077-a49a-5dcd5d598e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b421f11-c971-4077-a49a-5dcd5d598e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a53757-e132-4a4d-b47e-8b9e9ee05efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:26 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume 482ae5e7-5ca7-4f76-b3fd-4ad4647acd91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91', 'volume_size': 1} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:26 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68" returned: 0 in 0.680s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.330s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040580861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92dedf9-f21b-4de5-aa6c-beb780126db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571c56ccc86a4ad387e58a110b4fbade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:19:26Z,use_quota=True,user_id='6ac09932f0124eb08e9e627966c31e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Creating volume d92dedf9-f21b-4de5-aa6c-beb780126db5 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:19:26 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:19:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d92dedf9-f21b-4de5-aa6c-beb780126db5 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:27 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d92dedf9-f21b-4de5-aa6c-beb780126db5 1073741824 Jul 01 04:19:27 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4117c41-e02d-4767-ab1d-dc8cdfaedea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d6dacf-c878-41ae-b284-b4d5979188ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:27 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68 (6b0b9649-da92-4da1-bb52-5e997cc1cd68): created successfully Jul 01 04:19:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d6dacf-c878-41ae-b284-b4d5979188ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Flow 'volume_create_manager' (b522aaff-b77a-494d-a1d2-bf89556c35e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:19:27 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-6b943cd4-7138-4f11-a42e-a650acae0cc8 tempest-CreateVolumesFromSnapshotTest-541702497 None] Created volume successfully. Jul 01 04:19:27 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d92dedf9-f21b-4de5-aa6c-beb780126db5 1073741824" returned: 0 in 0.818s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d92dedf9-f21b-4de5-aa6c-beb780126db5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:27 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d92dedf9-f21b-4de5-aa6c-beb780126db5 Jul 01 04:19:27 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:28 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d92dedf9-f21b-4de5-aa6c-beb780126db5" returned: 0 in 0.630s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.446s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-151657079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38a517b-3196-499e-a6e2-4b01dbc9b20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571c56ccc86a4ad387e58a110b4fbade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:19:26Z,use_quota=True,user_id='6ac09932f0124eb08e9e627966c31e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Creating volume e38a517b-3196-499e-a6e2-4b01dbc9b20f {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:19:28 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d40d7f-c171-404c-be8b-609983e9e235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d92dedf9-f21b-4de5-aa6c-beb780126db5', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:28 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f 1073741824 Jul 01 04:19:28 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572d62d5-d1b9-4aef-b5c6-952a8867d412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:28 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume volume-d92dedf9-f21b-4de5-aa6c-beb780126db5 (d92dedf9-f21b-4de5-aa6c-beb780126db5): created successfully Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572d62d5-d1b9-4aef-b5c6-952a8867d412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Flow 'volume_create_manager' (c1a31f27-eee9-4089-8153-e6adee693625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:19:28 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-020cf74f-acfb-4225-bba0-381e94ecb61c tempest-CreateVolumesFromSnapshotTest-541702497 None] Created volume successfully. Jul 01 04:19:29 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f 1073741824" returned: 0 in 0.803s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:29 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f Jul 01 04:19:29 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:29 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f" returned: 0 in 0.640s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.523s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-656673738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27abb36f-7867-4923-a039-d3b769670845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571c56ccc86a4ad387e58a110b4fbade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:19:26Z,use_quota=True,user_id='6ac09932f0124eb08e9e627966c31e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Creating volume 27abb36f-7867-4923-a039-d3b769670845 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:19:29 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-27abb36f-7867-4923-a039-d3b769670845 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:29 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-27abb36f-7867-4923-a039-d3b769670845 1073741824 Jul 01 04:19:29 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a58626-8f79-4f04-8c2b-47b3bc7c090f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96110f48-87cf-4ad5-ae44-f9fb0b77e5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:30 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f (e38a517b-3196-499e-a6e2-4b01dbc9b20f): created successfully Jul 01 04:19:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96110f48-87cf-4ad5-ae44-f9fb0b77e5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:30 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Flow 'volume_create_manager' (0d9d3aa4-ce2e-43bf-aa01-937eb91ddd5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:19:30 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-a89628cc-f861-4681-8fe1-1efe8892a3f4 tempest-CreateVolumesFromSnapshotTest-541702497 None] Created volume successfully. Jul 01 04:19:30 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-27abb36f-7867-4923-a039-d3b769670845 1073741824" returned: 0 in 0.810s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-27abb36f-7867-4923-a039-d3b769670845 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:30 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-27abb36f-7867-4923-a039-d3b769670845 Jul 01 04:19:30 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:31 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-27abb36f-7867-4923-a039-d3b769670845" returned: 0 in 0.628s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.673s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-891887934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482ae5e7-5ca7-4f76-b3fd-4ad4647acd91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571c56ccc86a4ad387e58a110b4fbade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:19:27Z,use_quota=True,user_id='6ac09932f0124eb08e9e627966c31e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Creating volume 482ae5e7-5ca7-4f76-b3fd-4ad4647acd91 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:19:31 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49723dbe-9ad4-4836-8429-259d5693626b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27abb36f-7867-4923-a039-d3b769670845', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:31 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91 1073741824 Jul 01 04:19:31 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b869763-6d2a-4fc0-b697-97450c16d23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:31 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume volume-27abb36f-7867-4923-a039-d3b769670845 (27abb36f-7867-4923-a039-d3b769670845): created successfully Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b869763-6d2a-4fc0-b697-97450c16d23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:31 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Flow 'volume_create_manager' (2a14e2f1-f4e9-4ef7-988e-b2bfea903044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:19:31 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-31529bf0-54ab-4d74-8c60-43e7b74c7105 tempest-CreateVolumesFromSnapshotTest-541702497 None] Created volume successfully. Jul 01 04:19:32 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91 1073741824" returned: 0 in 0.819s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:32 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91 Jul 01 04:19:32 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:32 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91" returned: 0 in 0.633s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:19:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a53757-e132-4a4d-b47e-8b9e9ee05efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011bcecb-83ff-4e7e-ac54-6c81f590a52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:32 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Volume volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91 (482ae5e7-5ca7-4f76-b3fd-4ad4647acd91): created successfully Jul 01 04:19:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011bcecb-83ff-4e7e-ac54-6c81f590a52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Flow 'volume_create_manager' (badef333-537a-49f3-a727-b8def1d7b93e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:19:32 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c06ebef8-5efb-43a6-a784-3270ce44b5b1 tempest-CreateVolumesFromSnapshotTest-541702497 None] Created volume successfully. Jul 01 04:19:33 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "cinder-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:33 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:33 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "cinder-quobyte-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:33 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91" acquired by "delete_volume" :: waited 0.013s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:33 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d621cc17-ec14-4ba0-bd11-540242ff5c78]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:19:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:33 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91 Jul 01 04:19:33 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:34 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91" returned: 0 in 0.730s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:34 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91 Jul 01 04:19:34 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:34 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91" returned: 0 in 0.641s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:34 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91" released by "delete_volume" :: held 1.411s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:34 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Created reservations ['fe0187a9-7a16-4f69-b9e9-d615a3635393', '1fe85abf-f3a8-4e78-bc94-6e8ad5d4dc95', '61a1c590-458e-42e6-90ec-6322510b6ec2', '49a12b81-99e5-4de4-9b80-a43227993442'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:19:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:19:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:19:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:34 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:19:34 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "cinder-27abb36f-7867-4923-a039-d3b769670845-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:35 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.651s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-27abb36f-7867-4923-a039-d3b769670845-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:35 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:19:35 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Deleted volume successfully. Jul 01 04:19:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0067544b-da6c-4796-8097-663df05c2307 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-482ae5e7-5ca7-4f76-b3fd-4ad4647acd91-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "cinder-quobyte-27abb36f-7867-4923-a039-d3b769670845" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:35 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-27abb36f-7867-4923-a039-d3b769670845" acquired by "delete_volume" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:35 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[75614297-7646-4407-b0c0-4f7ddba1f376]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:19:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-27abb36f-7867-4923-a039-d3b769670845 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:35 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-27abb36f-7867-4923-a039-d3b769670845 Jul 01 04:19:35 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:36 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-27abb36f-7867-4923-a039-d3b769670845" returned: 0 in 0.763s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-27abb36f-7867-4923-a039-d3b769670845 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:36 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-27abb36f-7867-4923-a039-d3b769670845 Jul 01 04:19:36 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:36 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-27abb36f-7867-4923-a039-d3b769670845" returned: 0 in 0.630s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:36 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-27abb36f-7867-4923-a039-d3b769670845" released by "delete_volume" :: held 1.433s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:36 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Created reservations ['f48e4157-c723-43a6-8d87-b89a0ff36350', 'a4c30dab-e7c1-4ea0-a39e-277f3496cc26', 'b7992501-d749-4c34-96ff-d906c4ec2b17', '35bc33f7-42c8-4a66-86a9-57c5e5752e2b'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:19:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:19:37 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:19:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:37 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:19:37 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:37 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "cinder-e38a517b-3196-499e-a6e2-4b01dbc9b20f-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:37 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-e38a517b-3196-499e-a6e2-4b01dbc9b20f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:37 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.641s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:37 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:19:37 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Deleted volume successfully. Jul 01 04:19:37 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-5cb98de4-43cd-4bd7-b15e-41bb2358ba2b tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-27abb36f-7867-4923-a039-d3b769670845-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:37 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "cinder-quobyte-e38a517b-3196-499e-a6e2-4b01dbc9b20f" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:37 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-e38a517b-3196-499e-a6e2-4b01dbc9b20f" acquired by "delete_volume" :: waited 0.015s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:37 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a589d50f-9f04-44bd-b90d-9c8351ef152c]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:19:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:37 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f Jul 01 04:19:37 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:38 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f" returned: 0 in 0.742s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:38 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f Jul 01 04:19:38 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:39 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-e38a517b-3196-499e-a6e2-4b01dbc9b20f" returned: 0 in 0.638s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-e38a517b-3196-499e-a6e2-4b01dbc9b20f" released by "delete_volume" :: held 1.420s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Created reservations ['9890a5c1-80c0-4f15-ae6c-c8dc87be468a', 'fadba75f-2e68-4caf-aa41-b75d08124b88', '5b164ef4-b7c3-4ee6-9245-e85b91b34be3', '89182aa7-e87e-4bd1-b17e-b838287aab0c'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:39 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:19:39 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "cinder-d92dedf9-f21b-4de5-aa6c-beb780126db5-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:39 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.639s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:19:39 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Deleted volume successfully. Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-d92dedf9-f21b-4de5-aa6c-beb780126db5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7a8215f1-d692-4b9d-9823-bb90c66e609f tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-e38a517b-3196-499e-a6e2-4b01dbc9b20f-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "cinder-quobyte-d92dedf9-f21b-4de5-aa6c-beb780126db5" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-d92dedf9-f21b-4de5-aa6c-beb780126db5" acquired by "delete_volume" :: waited 0.013s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ceda5c8-e10a-4cfe-ac1b-0e2fa20c7271]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:19:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d92dedf9-f21b-4de5-aa6c-beb780126db5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:40 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d92dedf9-f21b-4de5-aa6c-beb780126db5 Jul 01 04:19:40 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:40 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d92dedf9-f21b-4de5-aa6c-beb780126db5" returned: 0 in 0.735s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d92dedf9-f21b-4de5-aa6c-beb780126db5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:40 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d92dedf9-f21b-4de5-aa6c-beb780126db5 Jul 01 04:19:40 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:41 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d92dedf9-f21b-4de5-aa6c-beb780126db5" returned: 0 in 0.630s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:41 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-d92dedf9-f21b-4de5-aa6c-beb780126db5" released by "delete_volume" :: held 1.403s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:41 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Created reservations ['3b7b006a-8a3e-4569-b39c-5be3aaefef25', '989c1f44-6303-438d-ad8a-f0ad9de58aba', '8b0fd13d-cca0-4210-89f4-e03eca31e10f', 'c42e6e54-3288-4b42-baee-e7372792b945'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:19:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:19:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:19:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:41 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:19:41 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:42 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.625s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:42 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:19:42 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Deleted volume successfully. Jul 01 04:19:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "cinder-6b0b9649-da92-4da1-bb52-5e997cc1cd68-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-49d9010b-372b-4ff3-9705-5e1ef5f6b050 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-d92dedf9-f21b-4de5-aa6c-beb780126db5-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-6b0b9649-da92-4da1-bb52-5e997cc1cd68-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "cinder-quobyte-6b0b9649-da92-4da1-bb52-5e997cc1cd68" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-6b0b9649-da92-4da1-bb52-5e997cc1cd68" acquired by "delete_volume" :: waited 0.014s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:42 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bd2a26-7a7d-4330-935c-873bc17d406e]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:19:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:42 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68 Jul 01 04:19:42 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:42 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68" returned: 0 in 0.760s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:43 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68 Jul 01 04:19:43 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:43 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6b0b9649-da92-4da1-bb52-5e997cc1cd68" returned: 0 in 0.679s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-6b0b9649-da92-4da1-bb52-5e997cc1cd68" released by "delete_volume" :: held 1.478s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:43 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Created reservations ['16a84def-baaf-4a81-9405-3b0620eb1c64', '8e817e5c-ae76-4251-88ee-5deafb47cff2', '8f962fc4-90f5-4fd3-8d5e-75a8a554ad09', 'aed7fd1d-afd3-4314-81f3-8617402709c8'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:19:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:19:43 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:19:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:43 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:19:43 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "cinder-4056225e-5f58-4c3f-acf9-948bbe108776-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-4056225e-5f58-4c3f-acf9-948bbe108776-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "cinder-quobyte-1bfa5f01-8482-4a15-94a5-62ddd6ca1285" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-1bfa5f01-8482-4a15-94a5-62ddd6ca1285" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "cinder-quobyte-4056225e-5f58-4c3f-acf9-948bbe108776" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:44 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.637s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:44 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:19:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-4056225e-5f58-4c3f-acf9-948bbe108776" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Deleting offline snapshot 4056225e-5f58-4c3f-acf9-948bbe108776 of volume 1bfa5f01-8482-4a15-94a5-62ddd6ca1285 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:19:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] snapshot_file for this snap is: volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:19:44 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Deleted volume successfully. Jul 01 04:19:44 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[90733f03-2747-43a7-b8ce-078e5a91b7c5]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:19:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-40d77d3c-126a-4d8c-ac9e-fecebd6d67ee tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-6b0b9649-da92-4da1-bb52-5e997cc1cd68-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:44 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776 Jul 01 04:19:44 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:45 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776" returned: 0 in 0.768s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:45 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:19:45 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d2e341-01b1-457d-b6e8-f77827b222b5]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:19:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:45 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 Jul 01 04:19:45 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:46 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285" returned: 0 in 0.756s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:46 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776 Jul 01 04:19:46 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:46 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776" returned: 0 in 0.708s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:46 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776 Jul 01 04:19:46 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:47 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285.4056225e-5f58-4c3f-acf9-948bbe108776" returned: 0 in 0.649s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:47 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-4056225e-5f58-4c3f-acf9-948bbe108776" released by "_delete_snapshot" :: held 2.992s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:47 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-1bfa5f01-8482-4a15-94a5-62ddd6ca1285" released by "delete_snapshot" :: held 3.021s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:47 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Created reservations ['a015c9a2-5eeb-4942-8a8a-a721755493e1', '7ff2cb88-59af-408a-a7e2-3237eca74d41', '2bb7d9d3-daa0-4fd5-9fd2-dec80946554d', '54064df6-7d5b-4fa7-b97d-c810743a89c9'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:19:47 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Delete snapshot completed successfully. Jul 01 04:19:47 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-809703aa-7abb-4454-a286-a69eeead8c56 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-4056225e-5f58-4c3f-acf9-948bbe108776-delete_snapshot" released by "delete_snapshot" :: held 3.153s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "cinder-1bfa5f01-8482-4a15-94a5-62ddd6ca1285-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-1bfa5f01-8482-4a15-94a5-62ddd6ca1285-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "cinder-quobyte-1bfa5f01-8482-4a15-94a5-62ddd6ca1285" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:19:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-1bfa5f01-8482-4a15-94a5-62ddd6ca1285" acquired by "delete_volume" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:19:48 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[570be2ac-88ea-4bbd-9e2a-7e6a8f68288b]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:19:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:48 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 Jul 01 04:19:48 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:49 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285" returned: 0 in 0.742s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:49 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285 Jul 01 04:19:49 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:50 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-1bfa5f01-8482-4a15-94a5-62ddd6ca1285" returned: 0 in 0.643s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-quobyte-1bfa5f01-8482-4a15-94a5-62ddd6ca1285" released by "delete_volume" :: held 1.440s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:50 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Created reservations ['48e218f6-a3a1-450c-9206-d7ddff81e9b1', '0f26eff3-1fea-4e6d-a70e-b4a79999a403', 'e699bc0f-0782-440b-abfe-f152f817cfdc', '8ddc3a70-e28c-4eb6-892d-b6a469d1c878'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:19:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:19:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:19:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:50 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:19:50 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:50 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.636s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:50 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:19:50 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Deleted volume successfully. Jul 01 04:19:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-f25122e8-4640-46ca-b10c-ed2c29838bd6 tempest-CreateVolumesFromSnapshotTest-541702497 None] Lock "cinder-1bfa5f01-8482-4a15-94a5-62ddd6ca1285-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:19:55 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:19:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Flow 'volume_create_manager' (dd6df67c-d786-4146-b969-ea30ec342153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:19:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56f9449-6d58-402a-89cc-b745afb17519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56f9449-6d58-402a-89cc-b745afb17519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f810eb21-af15-4638-8602-cf1b7db1ebd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d6da927ef04ae3a02fbe53164a8a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:19:56Z,use_quota=True,user_id='25157b1ae814471a9e7b46c676ad7a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a3ac5e-ab4f-417f-b1c7-409695075298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a3ac5e-ab4f-417f-b1c7-409695075298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf210817-bce0-4cbb-93bb-461298a118c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:55 devstack cinder-volume[86177]: DEBUG cinder.image.glance [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Creating Keystone auth plugin from conf {{(pid=86177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 04:19:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf210817-bce0-4cbb-93bb-461298a118c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f810eb21-af15-4638-8602-cf1b7db1ebd9', 'volume_name': 'volume-f810eb21-af15-4638-8602-cf1b7db1ebd9', 'volume_size': 1, 'image_id': '0e53d98e-d39e-4622-9a6a-e630061f0560', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e53d98e-d39e-4622-9a6a-e630061f0560', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1a1b195499e66a3896bc48452be7678', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c6d6da927ef04ae3a02fbe53164a8a27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b5448236ab68e7fe4800e3a099f3064618f78dd9b9c5f73eb2f94224c7236313316aec30c5cbfa3d2d70cff73fb8deb72f2c1813a9c0d52a0eb7e3437ef7b80', 'id': '0e53d98e-d39e-4622-9a6a-e630061f0560', 'created_at': datetime.datetime(2026, 7, 1, 2, 19, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 2, 19, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e53d98e-d39e-4622-9a6a-e630061f0560/file', 'properties': {}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f818572-2e06-40b9-a02b-f639e08115fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f818572-2e06-40b9-a02b-f639e08115fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:19:55 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5821da-b2d9-4a59-9e61-a355413af19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:19:55 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Volume f810eb21-af15-4638-8602-cf1b7db1ebd9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f810eb21-af15-4638-8602-cf1b7db1ebd9', 'volume_size': 1, 'image_id': '0e53d98e-d39e-4622-9a6a-e630061f0560', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e53d98e-d39e-4622-9a6a-e630061f0560', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1a1b195499e66a3896bc48452be7678', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c6d6da927ef04ae3a02fbe53164a8a27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b5448236ab68e7fe4800e3a099f3064618f78dd9b9c5f73eb2f94224c7236313316aec30c5cbfa3d2d70cff73fb8deb72f2c1813a9c0d52a0eb7e3437ef7b80', 'id': '0e53d98e-d39e-4622-9a6a-e630061f0560', 'created_at': datetime.datetime(2026, 7, 1, 2, 19, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 2, 19, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e53d98e-d39e-4622-9a6a-e630061f0560/file', 'properties': {}}, 'image_service': } Jul 01 04:19:55 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Trying to clone f810eb21-af15-4638-8602-cf1b7db1ebd9 from image 0e53d98e-d39e-4622-9a6a-e630061f0560 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e53d98e-d39e-4622-9a6a-e630061f0560', 'metadata': {}}]). {{(pid=86177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 04:19:55 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 04:19:55 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Image download 0.00 MB at 0.00 MB/s Jul 01 04:19:56 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[83261c1b-58ef-4ef0-9cf6-5efbdc615d11]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:19:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:56 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD Jul 01 04:19:56 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:56 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD" returned: 0 in 0.717s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:56 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD Jul 01 04:19:56 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:57 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD" returned: 1 in 0.704s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:19:57 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Temporary image 0e53d98e-d39e-4622-9a6a-e630061f0560 is fetched for user 25157b1ae814471a9e7b46c676ad7a79. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 04:19:57 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6b1f80-3b00-4ed8-8a66-f48d2cf7f19e]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:19:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:57 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD Jul 01 04:19:57 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:58 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD" returned: 0 in 0.712s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:58 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD Jul 01 04:19:58 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:58 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD" returned: 1 in 0.705s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:19:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f810eb21-af15-4638-8602-cf1b7db1ebd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d6da927ef04ae3a02fbe53164a8a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:19:56Z,use_quota=True,user_id='25157b1ae814471a9e7b46c676ad7a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:19:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Creating volume f810eb21-af15-4638-8602-cf1b7db1ebd9 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:19:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:19:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:19:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:19:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:19:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:19:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:19:58 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:19:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:58 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 1073741824 Jul 01 04:19:58 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:19:59 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Jul 01 04:19:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 1073741824" returned: 0 in 0.807s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:19:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:19:59 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 Jul 01 04:19:59 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:00 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9" returned: 0 in 0.630s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:20:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:00 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Attempting download of 0e53d98e-d39e-4622-9a6a-e630061f0560 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e53d98e-d39e-4622-9a6a-e630061f0560', 'metadata': {}}])) to volume f810eb21-af15-4638-8602-cf1b7db1ebd9. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 04:20:00 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[901e431b-5446-4616-a065-543d2a90f510]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:20:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e53d98e-d39e-4622-9a6a-e630061f0560_acp_yv3n {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:00 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e53d98e-d39e-4622-9a6a-e630061f0560_acp_yv3n Jul 01 04:20:00 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:01 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e53d98e-d39e-4622-9a6a-e630061f0560_acp_yv3n" returned: 0 in 0.720s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e53d98e-d39e-4622-9a6a-e630061f0560_acp_yv3n {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:01 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e53d98e-d39e-4622-9a6a-e630061f0560_acp_yv3n Jul 01 04:20:01 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:01 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e53d98e-d39e-4622-9a6a-e630061f0560_acp_yv3n" returned: 1 in 0.744s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e53d98e-d39e-4622-9a6a-e630061f0560_acp_yv3n' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:20:01 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[719db773-1eaf-4781-bf9c-d814d8e48078]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:20:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:02 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD Jul 01 04:20:02 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:02 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD" returned: 0 in 0.711s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:02 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD Jul 01 04:20:02 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:03 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD" returned: 1 in 0.693s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:20:03 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] 0e53d98e-d39e-4622-9a6a-e630061f0560 was raw, converting to raw {{(pid=86177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 04:20:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:03 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 Jul 01 04:20:03 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:04 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9" returned: 0 in 0.760s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:04 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e53d98e-d39e-4622-9a6a-e630061f0560_yplgnwrwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:20:04 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Converted 0.00 MB image at 0.00 MB/s Jul 01 04:20:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:04 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 1G Jul 01 04:20:04 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:04 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 1G" returned: 0 in 0.646s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:04 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[526e30fd-f7eb-40ad-91ad-3a1f775c7ddf]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:20:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:04 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 Jul 01 04:20:04 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:05 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9" returned: 0 in 0.730s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:05 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 Jul 01 04:20:05 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:06 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9" returned: 1 in 0.728s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:20:06 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Downloaded image 0e53d98e-d39e-4622-9a6a-e630061f0560 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e53d98e-d39e-4622-9a6a-e630061f0560', 'metadata': {}}])) to volume f810eb21-af15-4638-8602-cf1b7db1ebd9 successfully. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 04:20:06 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Temporary image 0e53d98e-d39e-4622-9a6a-e630061f0560 for user 25157b1ae814471a9e7b46c676ad7a79 is deleted. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 04:20:06 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Marking volume f810eb21-af15-4638-8602-cf1b7db1ebd9 as bootable. {{(pid=86177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 04:20:06 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Copying metadata from image 0e53d98e-d39e-4622-9a6a-e630061f0560 to f810eb21-af15-4638-8602-cf1b7db1ebd9. {{(pid=86177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 04:20:06 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Creating volume glance metadata for volume f810eb21-af15-4638-8602-cf1b7db1ebd9 backed by image 0e53d98e-d39e-4622-9a6a-e630061f0560 with: {'image_id': '0e53d98e-d39e-4622-9a6a-e630061f0560', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e1a1b195499e66a3896bc48452be7678', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 04:20:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5821da-b2d9-4a59-9e61-a355413af19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f810eb21-af15-4638-8602-cf1b7db1ebd9', 'volume_size': 1, 'image_id': '0e53d98e-d39e-4622-9a6a-e630061f0560', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e53d98e-d39e-4622-9a6a-e630061f0560', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1a1b195499e66a3896bc48452be7678', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c6d6da927ef04ae3a02fbe53164a8a27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b5448236ab68e7fe4800e3a099f3064618f78dd9b9c5f73eb2f94224c7236313316aec30c5cbfa3d2d70cff73fb8deb72f2c1813a9c0d52a0eb7e3437ef7b80', 'id': '0e53d98e-d39e-4622-9a6a-e630061f0560', 'created_at': datetime.datetime(2026, 7, 1, 2, 19, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 2, 19, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e53d98e-d39e-4622-9a6a-e630061f0560/file', 'properties': {}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bed4110-8d7a-4d31-8009-eb22e25dfe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:06 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Volume volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 (f810eb21-af15-4638-8602-cf1b7db1ebd9): created successfully Jul 01 04:20:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bed4110-8d7a-4d31-8009-eb22e25dfe36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Flow 'volume_create_manager' (dd6df67c-d786-4146-b969-ea30ec342153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:06 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d9f40f13-1bcd-41c7-81fe-6d1d4000ebe8 tempest-VolumeImageDependencyTests-1608127478 None] Created volume successfully. Jul 01 04:20:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Acquiring lock "cinder-f810eb21-af15-4638-8602-cf1b7db1ebd9-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:20:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Lock "cinder-f810eb21-af15-4638-8602-cf1b7db1ebd9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:20:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Acquiring lock "cinder-quobyte-f810eb21-af15-4638-8602-cf1b7db1ebd9" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:20:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Lock "cinder-quobyte-f810eb21-af15-4638-8602-cf1b7db1ebd9" acquired by "delete_volume" :: waited 0.014s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:20:07 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd95774-1a10-4699-bf1d-fb1eea95ada3]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:20:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:07 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 Jul 01 04:20:07 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:08 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9" returned: 0 in 0.729s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:08 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 Jul 01 04:20:08 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:08 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9" returned: 1 in 0.720s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:20:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:08 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9 Jul 01 04:20:08 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:09 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f810eb21-af15-4638-8602-cf1b7db1ebd9" returned: 0 in 0.638s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:09 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Lock "cinder-quobyte-f810eb21-af15-4638-8602-cf1b7db1ebd9" released by "delete_volume" :: held 2.145s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:20:09 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Created reservations ['775e2951-feb2-4361-8b4f-5283645a4428', '716f7f2e-1c22-4b15-94d6-42391d0cb7b7', '1c5afb21-5beb-42c8-a870-5b878322dd3c', '25bb1254-3a01-4f25-a848-7ccdcb1ee9b2'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:20:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:09 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:20:09 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:10 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.630s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:10 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:20:10 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Deleted volume successfully. Jul 01 04:20:10 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a6d8f50d-76ee-418b-b25c-4d0374170fd6 tempest-VolumeImageDependencyTests-1608127478 None] Lock "cinder-f810eb21-af15-4638-8602-cf1b7db1ebd9-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Flow 'volume_create_manager' (2121243f-bb1e-4947-b78b-385e7f836d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2772672b-d117-4bb8-817c-ae01670731da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2772672b-d117-4bb8-817c-ae01670731da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33f5661-96b6-4da2-a73f-a7ee073aef89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a425dfc1a107454d9a0fa8907811634c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:13Z,use_quota=True,user_id='80902af48ead40fd9d9f35d3f769a886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd73d34-e9eb-4ebc-b4cc-55fc04914d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd73d34-e9eb-4ebc-b4cc-55fc04914d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4291608-f3d2-417f-a9bb-80176014bd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4291608-f3d2-417f-a9bb-80176014bd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c33f5661-96b6-4da2-a73f-a7ee073aef89', 'volume_name': 'volume-c33f5661-96b6-4da2-a73f-a7ee073aef89', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a0b00b-7514-4a13-9946-ca30a5aeabf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a0b00b-7514-4a13-9946-ca30a5aeabf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d98b15a-cea4-4854-9c21-bac4d5cbd63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:13 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Volume c33f5661-96b6-4da2-a73f-a7ee073aef89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c33f5661-96b6-4da2-a73f-a7ee073aef89', 'volume_size': 1} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33f5661-96b6-4da2-a73f-a7ee073aef89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a425dfc1a107454d9a0fa8907811634c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:13Z,use_quota=True,user_id='80902af48ead40fd9d9f35d3f769a886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Creating volume c33f5661-96b6-4da2-a73f-a7ee073aef89 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:20:13 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:20:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c33f5661-96b6-4da2-a73f-a7ee073aef89 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:13 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c33f5661-96b6-4da2-a73f-a7ee073aef89 1073741824 Jul 01 04:20:13 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:14 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c33f5661-96b6-4da2-a73f-a7ee073aef89 1073741824" returned: 0 in 0.799s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c33f5661-96b6-4da2-a73f-a7ee073aef89 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:14 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c33f5661-96b6-4da2-a73f-a7ee073aef89 Jul 01 04:20:14 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:14 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c33f5661-96b6-4da2-a73f-a7ee073aef89" returned: 0 in 0.645s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:20:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d98b15a-cea4-4854-9c21-bac4d5cbd63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c33f5661-96b6-4da2-a73f-a7ee073aef89', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f54e8c-fa10-457f-82b9-9460ae00f678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:14 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Volume volume-c33f5661-96b6-4da2-a73f-a7ee073aef89 (c33f5661-96b6-4da2-a73f-a7ee073aef89): created successfully Jul 01 04:20:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f54e8c-fa10-457f-82b9-9460ae00f678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Flow 'volume_create_manager' (2121243f-bb1e-4947-b78b-385e7f836d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:14 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-ec0321fe-2a17-4e76-8dde-6e5803517ef0 tempest-CinderUnicodeTest-1896015031 None] Created volume successfully. Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Flow 'volume_create_manager' (0a35fac4-90da-40c0-a6f9-91836beb0d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39361781-2b9b-4896-8d4a-92dae58e8046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39361781-2b9b-4896-8d4a-92dae58e8046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2086302435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828adcd4-e9e2-447e-83ae-6ee127dee4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a425dfc1a107454d9a0fa8907811634c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:16Z,use_quota=True,user_id='80902af48ead40fd9d9f35d3f769a886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63047fad-51dd-4741-bac7-c6012f58e0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63047fad-51dd-4741-bac7-c6012f58e0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7d277c-207c-448a-8c9c-1e328c351b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7d277c-207c-448a-8c9c-1e328c351b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '828adcd4-e9e2-447e-83ae-6ee127dee4c8', 'volume_name': 'volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f684a647-1856-4b49-9028-5444ea713e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f684a647-1856-4b49-9028-5444ea713e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d354bc0-1af4-4e69-99b7-c489a71c351a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:15 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Volume 828adcd4-e9e2-447e-83ae-6ee127dee4c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8', 'volume_size': 1} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2086302435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828adcd4-e9e2-447e-83ae-6ee127dee4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a425dfc1a107454d9a0fa8907811634c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:16Z,use_quota=True,user_id='80902af48ead40fd9d9f35d3f769a886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Creating volume 828adcd4-e9e2-447e-83ae-6ee127dee4c8 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:20:15 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:20:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:16 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 1073741824 Jul 01 04:20:16 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:16 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 1073741824" returned: 0 in 0.806s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:16 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=93,cinder:SELECT=70,cinder:DELETE=9,cinder:INSERT=24 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:20:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:16 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 Jul 01 04:20:16 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:17 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8" returned: 0 in 0.631s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:20:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:17 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=65,cinder:INSERT=27,cinder:UPDATE=88,cinder:DELETE=7 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:20:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d354bc0-1af4-4e69-99b7-c489a71c351a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825cd72e-2e0b-46d9-a7dc-9fffc84403d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:17 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Volume volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 (828adcd4-e9e2-447e-83ae-6ee127dee4c8): created successfully Jul 01 04:20:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825cd72e-2e0b-46d9-a7dc-9fffc84403d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Flow 'volume_create_manager' (0a35fac4-90da-40c0-a6f9-91836beb0d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:17 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-a9c767aa-3e4a-4ed3-851d-d96efc8f4e3a tempest-CinderUnicodeTest-1896015031 None] Created volume successfully. Jul 01 04:20:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] Creating offline snapshot 39f3a05a-e20a-444f-a80f-9b5c54a10ed2 of volume 828adcd4-e9e2-447e-83ae-6ee127dee4c8 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:20:18 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c48258-6cb2-4fb7-a270-d327a2f2cf79]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:20:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:18 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 Jul 01 04:20:18 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:18 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8" returned: 0 in 0.741s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:18 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2 1G Jul 01 04:20:18 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:19 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2 1G" returned: 0 in 0.778s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:19 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2 Jul 01 04:20:19 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:20 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2" returned: 0 in 0.675s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:20 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2 is being set with open permissions: ugo+rw Jul 01 04:20:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:20 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2 Jul 01 04:20:20 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:21 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2" returned: 0 in 0.639s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:21 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.info Jul 01 04:20:21 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:21 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.info" returned: 0 in 0.635s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:21 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.info is being set with open permissions: ugo+rw Jul 01 04:20:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:21 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.info Jul 01 04:20:21 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:22 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.info" returned: 0 in 0.629s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.180s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:22 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-5c863351-19a1-40e2-95ce-05047931ae40 tempest-CinderUnicodeTest-1896015031 None] Create snapshot completed successfully Jul 01 04:20:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Acquiring lock "cinder-39f3a05a-e20a-444f-a80f-9b5c54a10ed2-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:20:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Lock "cinder-39f3a05a-e20a-444f-a80f-9b5c54a10ed2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:20:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Acquiring lock "cinder-quobyte-828adcd4-e9e2-447e-83ae-6ee127dee4c8" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:20:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Lock "cinder-quobyte-828adcd4-e9e2-447e-83ae-6ee127dee4c8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:20:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Acquiring lock "cinder-quobyte-39f3a05a-e20a-444f-a80f-9b5c54a10ed2" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:20:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Lock "cinder-quobyte-39f3a05a-e20a-444f-a80f-9b5c54a10ed2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:20:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Deleting offline snapshot 39f3a05a-e20a-444f-a80f-9b5c54a10ed2 of volume 828adcd4-e9e2-447e-83ae-6ee127dee4c8 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:20:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] snapshot_file for this snap is: volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:20:23 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd29000-0c5f-4733-9512-b813219df700]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:20:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:23 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2 Jul 01 04:20:23 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:24 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2" returned: 0 in 0.730s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:20:24 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dbe543-1ee7-4842-90e2-5e3900149216]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:20:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:24 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 Jul 01 04:20:24 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:20:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:24 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:20:24 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:24 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8" returned: 0 in 0.741s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:24 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2 Jul 01 04:20:24 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:25 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.654s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:20:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:20:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:20:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:20:25 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2" returned: 0 in 0.726s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:25 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2 Jul 01 04:20:25 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:26 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8.39f3a05a-e20a-444f-a80f-9b5c54a10ed2" returned: 0 in 0.640s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Lock "cinder-quobyte-39f3a05a-e20a-444f-a80f-9b5c54a10ed2" released by "_delete_snapshot" :: held 2.931s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:20:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Lock "cinder-quobyte-828adcd4-e9e2-447e-83ae-6ee127dee4c8" released by "delete_snapshot" :: held 2.952s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:20:26 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Created reservations ['01b8bc68-70a0-4838-a604-4f4a70abc0f4', 'd7715b58-df58-4670-9605-09da533a1cc9', 'ec93839a-12dd-4005-9b6d-427bed40722a', 'e90aa82d-7b55-4153-a507-a772642ee106'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:20:26 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Delete snapshot completed successfully. Jul 01 04:20:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bacae181-51d9-4be6-9515-c7ae6f77204f tempest-CinderUnicodeTest-1896015031 None] Lock "cinder-39f3a05a-e20a-444f-a80f-9b5c54a10ed2-delete_snapshot" released by "delete_snapshot" :: held 3.079s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:20:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Acquiring lock "cinder-828adcd4-e9e2-447e-83ae-6ee127dee4c8-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:20:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Lock "cinder-828adcd4-e9e2-447e-83ae-6ee127dee4c8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:20:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Acquiring lock "cinder-quobyte-828adcd4-e9e2-447e-83ae-6ee127dee4c8" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:20:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Lock "cinder-quobyte-828adcd4-e9e2-447e-83ae-6ee127dee4c8" acquired by "delete_volume" :: waited 0.013s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:20:26 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1234bf9e-1496-4a61-a72b-0a1964f4edc7]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:20:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:26 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 Jul 01 04:20:26 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:27 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8" returned: 0 in 0.742s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:27 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8 Jul 01 04:20:27 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:28 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-828adcd4-e9e2-447e-83ae-6ee127dee4c8" returned: 0 in 0.634s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Lock "cinder-quobyte-828adcd4-e9e2-447e-83ae-6ee127dee4c8" released by "delete_volume" :: held 1.430s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Created reservations ['55d237cb-3149-4da3-b50c-04edb5cbd8d0', '5988e173-2e54-4548-ab0a-78f1698e4683', '178985b7-8c5f-4168-adf5-af1c72a1c7ed', 'bb3a3dfd-eaa4-4735-8e79-9a18d872ae46'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:28 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:20:28 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Acquiring lock "cinder-c33f5661-96b6-4da2-a73f-a7ee073aef89-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:20:28 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.652s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Lock "cinder-c33f5661-96b6-4da2-a73f-a7ee073aef89-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:20:28 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Deleted volume successfully. Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-96ade36f-e556-4b11-a89d-1512d2b83a40 tempest-CinderUnicodeTest-1896015031 None] Lock "cinder-828adcd4-e9e2-447e-83ae-6ee127dee4c8-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Acquiring lock "cinder-quobyte-c33f5661-96b6-4da2-a73f-a7ee073aef89" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Lock "cinder-quobyte-c33f5661-96b6-4da2-a73f-a7ee073aef89" acquired by "delete_volume" :: waited 0.014s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5061c2-9113-48ef-96db-7cc9039370e5]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:20:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c33f5661-96b6-4da2-a73f-a7ee073aef89 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:28 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c33f5661-96b6-4da2-a73f-a7ee073aef89 Jul 01 04:20:28 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:29 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c33f5661-96b6-4da2-a73f-a7ee073aef89" returned: 0 in 0.753s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c33f5661-96b6-4da2-a73f-a7ee073aef89 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:29 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c33f5661-96b6-4da2-a73f-a7ee073aef89 Jul 01 04:20:29 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:30 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c33f5661-96b6-4da2-a73f-a7ee073aef89" returned: 0 in 0.635s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:30 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Lock "cinder-quobyte-c33f5661-96b6-4da2-a73f-a7ee073aef89" released by "delete_volume" :: held 1.425s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:20:30 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Created reservations ['6d2141d2-db25-435c-9839-0d095026482f', '026f0c1a-0fc3-4ed5-98b9-abdf71eb2562', 'c74a6b2a-ca56-4f56-9578-57ab197d929b', 'c1d2b43f-2e63-4fad-ae8b-b47ab7bf55d8'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:20:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:30 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:20:30 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:31 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.643s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:31 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:20:31 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Deleted volume successfully. Jul 01 04:20:31 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-6a5d90ce-4953-4cff-9944-9eaba7230d23 tempest-CinderUnicodeTest-1896015031 None] Lock "cinder-c33f5661-96b6-4da2-a73f-a7ee073aef89-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:20:40 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=24,cinder:DELETE=2,cinder:SELECT=16,cinder:INSERT=7 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:20:41 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Flow 'volume_create_manager' (82b65e78-14f7-4174-9dcf-70a0c6b1b612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395e76b1-06d3-4fc5-a11f-041d1597e8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395e76b1-06d3-4fc5-a11f-041d1597e8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1486523037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb67c7b-9148-45f3-96cb-71d86c0e6320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480307c20e4c46d886f457ddc8fdd7fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:42Z,use_quota=True,user_id='706e2dbd032c431683d7ba17c88f49ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8386f74-3e72-46d9-83ad-d567cf4d04d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8386f74-3e72-46d9-83ad-d567cf4d04d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c041b9a-f8c1-48fd-9631-5388f0437aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c041b9a-f8c1-48fd-9631-5388f0437aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb67c7b-9148-45f3-96cb-71d86c0e6320', 'volume_name': 'volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb4c79d-a25b-438a-9bc2-5d45c5dd0b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb4c79d-a25b-438a-9bc2-5d45c5dd0b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f27a09b-709e-414c-bde0-eb90bc690a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:42 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Volume 0bb67c7b-9148-45f3-96cb-71d86c0e6320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320', 'volume_size': 1} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1486523037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb67c7b-9148-45f3-96cb-71d86c0e6320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480307c20e4c46d886f457ddc8fdd7fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:42Z,use_quota=True,user_id='706e2dbd032c431683d7ba17c88f49ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Creating volume 0bb67c7b-9148-45f3-96cb-71d86c0e6320 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:20:42 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:42 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 1073741824 Jul 01 04:20:42 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Flow 'volume_create_manager' (17419c0a-20bd-4e6a-bb3f-1829b6a61e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c54718e-413b-4df5-bc90-aad58b09ebb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Flow 'volume_create_manager' (af1a3ba0-d0ff-4049-8f05-79447811e1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cab55d6-6152-49d7-bb6c-008c5931b02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cab55d6-6152-49d7-bb6c-008c5931b02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1761210677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35d3f70-e97b-4b49-b062-06eb0ad2e819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f0201fc8d94722be3b123057da2cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:42Z,use_quota=True,user_id='4b15227385154a4ca8c08c766395fc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd89be55-7f2b-477e-a9f6-86a8d75ccb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd89be55-7f2b-477e-a9f6-86a8d75ccb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f915755d-5211-4adc-b56a-05a73426c29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f915755d-5211-4adc-b56a-05a73426c29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b35d3f70-e97b-4b49-b062-06eb0ad2e819', 'volume_name': 'volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf9d94d-3d8b-43a7-9804-662486971922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf9d94d-3d8b-43a7-9804-662486971922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9395fb-454d-4468-a2a7-ecf3cf6e7cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:42 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Volume b35d3f70-e97b-4b49-b062-06eb0ad2e819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819', 'volume_size': 1} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c54718e-413b-4df5-bc90-aad58b09ebb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1519954424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f0201fc8d94722be3b123057da2cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:43Z,use_quota=True,user_id='4b15227385154a4ca8c08c766395fc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:42 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1b2e63-24c4-46d2-85c3-082a1a7c0545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1b2e63-24c4-46d2-85c3-082a1a7c0545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8354b18c-11ad-4207-b8b4-8ddccd221606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8354b18c-11ad-4207-b8b4-8ddccd221606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc', 'volume_name': 'volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f501c6e9-6907-49d5-8bf0-02ecc192a0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f501c6e9-6907-49d5-8bf0-02ecc192a0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b03c168-0aca-410c-a08d-f8868f25b8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:43 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Volume 3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc', 'volume_size': 1} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Flow 'volume_create_manager' (cf6a27e3-d5c7-477e-8344-e75515b92f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d2ee11-5c8e-4170-8ef4-d46fb7f8eead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d2ee11-5c8e-4170-8ef4-d46fb7f8eead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1521107339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7aabff6-6c80-422c-a0f5-076e1030985d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f0201fc8d94722be3b123057da2cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:43Z,use_quota=True,user_id='4b15227385154a4ca8c08c766395fc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec64e21-5dea-49bc-84fb-e64e3e34c67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec64e21-5dea-49bc-84fb-e64e3e34c67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a744e06f-1cad-420c-9ca2-c70242524ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a744e06f-1cad-420c-9ca2-c70242524ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7aabff6-6c80-422c-a0f5-076e1030985d', 'volume_name': 'volume-d7aabff6-6c80-422c-a0f5-076e1030985d', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4d1e33-8b07-4dc2-b08f-5dc93a1eb162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4d1e33-8b07-4dc2-b08f-5dc93a1eb162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064597f6-3b0b-4828-ba68-e870ff8ef42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:43 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Volume d7aabff6-6c80-422c-a0f5-076e1030985d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7aabff6-6c80-422c-a0f5-076e1030985d', 'volume_size': 1} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Flow 'volume_create_manager' (1f37236f-8202-4afb-8fff-d804db965154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284d7852-0771-4ee2-af60-afa6d43b53ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284d7852-0771-4ee2-af60-afa6d43b53ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b77b3b2-eaf8-4768-91dd-2c38fb3003f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ff6cee37d948b687a1dcc3ee6bba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:44Z,use_quota=True,user_id='13194def4b8345208064b66b1f27cdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28dd04fd-2097-46ab-bae8-7dacddfcd982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28dd04fd-2097-46ab-bae8-7dacddfcd982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:43 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d346794-3c3e-40cf-aed6-45173c843f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d346794-3c3e-40cf-aed6-45173c843f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b77b3b2-eaf8-4768-91dd-2c38fb3003f4', 'volume_name': 'volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57913f61-9b54-4231-afa5-068279ce53a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57913f61-9b54-4231-afa5-068279ce53a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e660898-dd6d-4441-9d83-f3b26e784e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:43 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Volume 9b77b3b2-eaf8-4768-91dd-2c38fb3003f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4', 'volume_size': 1} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 1073741824" returned: 0 in 1.243s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Flow 'volume_create_manager' (2f6ef6f9-a39f-498d-aec8-90be50618b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:43 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7eb6590-09d3-4bc5-91b0-38fc41dc3e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7eb6590-09d3-4bc5-91b0-38fc41dc3e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-415492194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f49406d-7300-4d15-8105-a38effc8f663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f0201fc8d94722be3b123057da2cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:44Z,use_quota=True,user_id='4b15227385154a4ca8c08c766395fc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b828f8a-488f-49f5-9515-d7445bdd9a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b828f8a-488f-49f5-9515-d7445bdd9a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d48021-6862-4f29-a1a4-0db91bed5424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d48021-6862-4f29-a1a4-0db91bed5424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f49406d-7300-4d15-8105-a38effc8f663', 'volume_name': 'volume-9f49406d-7300-4d15-8105-a38effc8f663', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3eadfdd-fca0-44c7-b682-d080235a4436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3eadfdd-fca0-44c7-b682-d080235a4436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e622889-2cb2-4cf6-ad8a-b4826a997c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:44 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Volume 9f49406d-7300-4d15-8105-a38effc8f663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f49406d-7300-4d15-8105-a38effc8f663', 'volume_size': 1} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:20:44 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Flow 'volume_create_manager' (9ca0abf6-f6af-4ddb-b51e-5c18a2098529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:44 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e83c51-e5c5-4145-88bb-8b25a0c8f8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e83c51-e5c5-4145-88bb-8b25a0c8f8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-790707175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d87bffe-7a22-4ae2-950c-5cef7f4f461a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f0201fc8d94722be3b123057da2cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:44Z,use_quota=True,user_id='4b15227385154a4ca8c08c766395fc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762c903a-5683-49b9-85d5-7783e25a277b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762c903a-5683-49b9-85d5-7783e25a277b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c064b88-301a-4331-81b3-1d62730927a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c064b88-301a-4331-81b3-1d62730927a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d87bffe-7a22-4ae2-950c-5cef7f4f461a', 'volume_name': 'volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2cde6c-052b-42e9-b8a7-0c3388bb2721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2cde6c-052b-42e9-b8a7-0c3388bb2721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb449e6b-c226-465e-8f5d-84d512974225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:44 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Volume 6d87bffe-7a22-4ae2-950c-5cef7f4f461a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a', 'volume_size': 1} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:44 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320" returned: 0 in 0.691s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.793s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1761210677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35d3f70-e97b-4b49-b062-06eb0ad2e819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f0201fc8d94722be3b123057da2cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:42Z,use_quota=True,user_id='4b15227385154a4ca8c08c766395fc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Creating volume b35d3f70-e97b-4b49-b062-06eb0ad2e819 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:20:44 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:44 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819 1073741824 Jul 01 04:20:44 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f27a09b-709e-414c-bde0-eb90bc690a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2510ca8e-2a22-4ef4-b902-9df263386513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:44 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Volume volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 (0bb67c7b-9148-45f3-96cb-71d86c0e6320): created successfully Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2510ca8e-2a22-4ef4-b902-9df263386513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:44 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Flow 'volume_create_manager' (82b65e78-14f7-4174-9dcf-70a0c6b1b612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:44 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1da4aa3e-5a95-4565-9139-e4bf9013401a tempest-VolumeDependencyTests-1223103193 None] Created volume successfully. Jul 01 04:20:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:45 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819 1073741824" returned: 0 in 0.950s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:45 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819 Jul 01 04:20:45 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Flow 'volume_create_manager' (8e01974d-f562-412b-9f22-f1de9d62c46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317f86c3-6444-412e-ad37-0ddd4aa72d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:46 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317f86c3-6444-412e-ad37-0ddd4aa72d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29ad0b2-7b07-4080-aacf-99ed8a56ca91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2456f922c8144a999c73aebfbbc7ba72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:46Z,use_quota=True,user_id='b9d2bb3bbb5447218a0cb21e941c3750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e10d39c-bdb4-409f-a150-61a951ba9307),volume_type_id=7e10d39c-bdb4-409f-a150-61a951ba9307)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60aab068-0f78-4da3-9ae7-264c83ee7f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60aab068-0f78-4da3-9ae7-264c83ee7f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4226f459-f1ae-4f14-8bdb-f0a551bb5b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.image.glance [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Creating Keystone auth plugin from conf {{(pid=86177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819" returned: 0 in 0.673s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.367s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1519954424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f0201fc8d94722be3b123057da2cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:43Z,use_quota=True,user_id='4b15227385154a4ca8c08c766395fc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Creating volume 3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:20:46 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9395fb-454d-4468-a2a7-ecf3cf6e7cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:46 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc 1073741824 Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67e2e6f-5ce7-468a-8990-5937e8f2c973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:46 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:46 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Volume volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819 (b35d3f70-e97b-4b49-b062-06eb0ad2e819): created successfully Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67e2e6f-5ce7-468a-8990-5937e8f2c973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Flow 'volume_create_manager' (af1a3ba0-d0ff-4049-8f05-79447811e1d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:46 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-bfcb14c4-96fd-48c6-bc18-8dd8b76b509d tempest-CreateVolumesFromImageTest-398734887 None] Created volume successfully. Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4226f459-f1ae-4f14-8bdb-f0a551bb5b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a29ad0b2-7b07-4080-aacf-99ed8a56ca91', 'volume_name': 'volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91', 'volume_size': 1, 'image_id': '594ac494-78df-4c3b-8514-fbcd0c78d9e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594ac494-78df-4c3b-8514-fbcd0c78d9e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '694f85b96dd46bdca6299658584c4dea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2456f922c8144a999c73aebfbbc7ba72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd953a691c3838a6cf8cb7c2b7eaaaf94e0d6c39c388a854ec4a98a7a0b1b672621c88b44ac885c5ee33b968bfc3e95aa51fb04ebe9605473825bdf3d72a04830', 'id': '594ac494-78df-4c3b-8514-fbcd0c78d9e6', 'created_at': datetime.datetime(2026, 7, 1, 2, 20, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 2, 20, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594ac494-78df-4c3b-8514-fbcd0c78d9e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d24982a-9222-445b-b1ee-79c422fb9895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d24982a-9222-445b-b1ee-79c422fb9895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e339cf8-0309-49c4-a728-b6b3cc3c9f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:46 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Volume a29ad0b2-7b07-4080-aacf-99ed8a56ca91: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91', 'volume_size': 1, 'image_id': '594ac494-78df-4c3b-8514-fbcd0c78d9e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594ac494-78df-4c3b-8514-fbcd0c78d9e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '694f85b96dd46bdca6299658584c4dea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2456f922c8144a999c73aebfbbc7ba72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd953a691c3838a6cf8cb7c2b7eaaaf94e0d6c39c388a854ec4a98a7a0b1b672621c88b44ac885c5ee33b968bfc3e95aa51fb04ebe9605473825bdf3d72a04830', 'id': '594ac494-78df-4c3b-8514-fbcd0c78d9e6', 'created_at': datetime.datetime(2026, 7, 1, 2, 20, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 2, 20, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594ac494-78df-4c3b-8514-fbcd0c78d9e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Trying to clone a29ad0b2-7b07-4080-aacf-99ed8a56ca91 from image 594ac494-78df-4c3b-8514-fbcd0c78d9e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/594ac494-78df-4c3b-8514-fbcd0c78d9e6', 'metadata': {}}]). {{(pid=86177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 04:20:46 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Image download 0.00 MB at 0.00 MB/s Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[279df071-5b7c-4720-9aaa-72291592bac6]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:20:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:46 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD Jul 01 04:20:46 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:47 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc 1073741824" returned: 0 in 0.874s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:47 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc Jul 01 04:20:47 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:47 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:47 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD Jul 01 04:20:47 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:47 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc" returned: 0 in 0.628s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.391s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1521107339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7aabff6-6c80-422c-a0f5-076e1030985d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f0201fc8d94722be3b123057da2cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:43Z,use_quota=True,user_id='4b15227385154a4ca8c08c766395fc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Creating volume d7aabff6-6c80-422c-a0f5-076e1030985d {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:20:47 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:20:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7aabff6-6c80-422c-a0f5-076e1030985d 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:48 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7aabff6-6c80-422c-a0f5-076e1030985d 1073741824 Jul 01 04:20:48 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:48 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b03c168-0aca-410c-a08d-f8868f25b8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:48 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3340d8-b970-47f0-a76e-49e271d09686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:48 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Volume volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc (3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc): created successfully Jul 01 04:20:48 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3340d8-b970-47f0-a76e-49e271d09686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:48 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Flow 'volume_create_manager' (17419c0a-20bd-4e6a-bb3f-1829b6a61e49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:48 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c20dc055-4697-4146-8f3f-c3c24e3023fa tempest-CreateVolumesFromImageTest-398734887 None] Created volume successfully. Jul 01 04:20:48 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD" returned: 1 in 0.713s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:20:48 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Temporary image 594ac494-78df-4c3b-8514-fbcd0c78d9e6 is fetched for user b9d2bb3bbb5447218a0cb21e941c3750. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 04:20:48 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[573e3f33-5b09-40ca-a1d3-c144682910a4]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:20:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:48 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD Jul 01 04:20:48 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:48 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7aabff6-6c80-422c-a0f5-076e1030985d 1073741824" returned: 0 in 0.873s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7aabff6-6c80-422c-a0f5-076e1030985d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:48 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7aabff6-6c80-422c-a0f5-076e1030985d Jul 01 04:20:48 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:49 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD" returned: 0 in 0.776s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:49 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD Jul 01 04:20:49 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:49 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7aabff6-6c80-422c-a0f5-076e1030985d" returned: 0 in 0.677s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.652s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b77b3b2-eaf8-4768-91dd-2c38fb3003f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ff6cee37d948b687a1dcc3ee6bba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:44Z,use_quota=True,user_id='13194def4b8345208064b66b1f27cdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Creating volume 9b77b3b2-eaf8-4768-91dd-2c38fb3003f4 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:20:49 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:49 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4 1073741824 Jul 01 04:20:49 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064597f6-3b0b-4828-ba68-e870ff8ef42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7aabff6-6c80-422c-a0f5-076e1030985d', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3901c2a2-639d-41cc-8e76-7c29748333c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:49 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Volume volume-d7aabff6-6c80-422c-a0f5-076e1030985d (d7aabff6-6c80-422c-a0f5-076e1030985d): created successfully Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3901c2a2-639d-41cc-8e76-7c29748333c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Flow 'volume_create_manager' (cf6a27e3-d5c7-477e-8344-e75515b92f05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:49 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-43041cf2-d231-4713-927e-91043ee904d8 tempest-CreateVolumesFromImageTest-398734887 None] Created volume successfully. Jul 01 04:20:49 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD" returned: 1 in 0.756s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:20:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:50 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4 1073741824" returned: 0 in 0.832s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:50 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4 Jul 01 04:20:50 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:51 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4" returned: 0 in 0.637s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.075s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-415492194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f49406d-7300-4d15-8105-a38effc8f663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f0201fc8d94722be3b123057da2cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:44Z,use_quota=True,user_id='4b15227385154a4ca8c08c766395fc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Creating volume 9f49406d-7300-4d15-8105-a38effc8f663 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:20:51 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f49406d-7300-4d15-8105-a38effc8f663 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:51 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f49406d-7300-4d15-8105-a38effc8f663 1073741824 Jul 01 04:20:51 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e660898-dd6d-4441-9d83-f3b26e784e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ddab13-8374-4eff-9dba-12ef205e6074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:51 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Volume volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4 (9b77b3b2-eaf8-4768-91dd-2c38fb3003f4): created successfully Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ddab13-8374-4eff-9dba-12ef205e6074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:51 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Flow 'volume_create_manager' (1f37236f-8202-4afb-8fff-d804db965154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:51 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-420f8cde-d910-4c87-a4ce-5a9d5f69180d tempest-CinderUnicodeTest-372545438 None] Created volume successfully. Jul 01 04:20:51 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f49406d-7300-4d15-8105-a38effc8f663 1073741824" returned: 0 in 0.863s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f49406d-7300-4d15-8105-a38effc8f663 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:52 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f49406d-7300-4d15-8105-a38effc8f663 Jul 01 04:20:52 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Flow 'volume_create_manager' (91b10f00-c028-4d8e-ba65-236ab2aa9ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4283c50d-4e91-470d-9079-c2c28c1568ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4283c50d-4e91-470d-9079-c2c28c1568ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-231616733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924d99ef-ce8d-4911-a726-f89db5d47648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ff6cee37d948b687a1dcc3ee6bba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:52Z,use_quota=True,user_id='13194def4b8345208064b66b1f27cdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6dd0b7-ad86-4083-9a16-6bc4411740b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6dd0b7-ad86-4083-9a16-6bc4411740b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ad5293-896c-4708-9022-2e93ff3938f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ad5293-896c-4708-9022-2e93ff3938f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '924d99ef-ce8d-4911-a726-f89db5d47648', 'volume_name': 'volume-924d99ef-ce8d-4911-a726-f89db5d47648', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae73d6ae-b8e2-41db-9715-6c7d5a24d648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae73d6ae-b8e2-41db-9715-6c7d5a24d648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1bc04b-fc5a-4393-bf9d-1f6455da8cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:52 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Volume 924d99ef-ce8d-4911-a726-f89db5d47648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-924d99ef-ce8d-4911-a726-f89db5d47648', 'volume_size': 1} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:52 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f49406d-7300-4d15-8105-a38effc8f663" returned: 0 in 0.636s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.503s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-790707175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d87bffe-7a22-4ae2-950c-5cef7f4f461a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f0201fc8d94722be3b123057da2cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:44Z,use_quota=True,user_id='4b15227385154a4ca8c08c766395fc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Creating volume 6d87bffe-7a22-4ae2-950c-5cef7f4f461a {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:20:52 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:52 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a 1073741824 Jul 01 04:20:52 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e622889-2cb2-4cf6-ad8a-b4826a997c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f49406d-7300-4d15-8105-a38effc8f663', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e0b4ec-ac4d-4545-9a68-5bed8f235a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:52 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Volume volume-9f49406d-7300-4d15-8105-a38effc8f663 (9f49406d-7300-4d15-8105-a38effc8f663): created successfully Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e0b4ec-ac4d-4545-9a68-5bed8f235a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Flow 'volume_create_manager' (2f6ef6f9-a39f-498d-aec8-90be50618b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:52 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-5e7175bc-539e-4343-8bd5-76c9d20d5f36 tempest-CreateVolumesFromImageTest-398734887 None] Created volume successfully. Jul 01 04:20:53 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a 1073741824" returned: 0 in 0.796s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:53 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a Jul 01 04:20:53 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:54 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a" returned: 0 in 0.619s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.553s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb449e6b-c226-465e-8f5d-84d512974225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4fa0cbb-3285-4257-985b-a24ebbd3c7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] Creating offline snapshot 2a0be507-94c8-4dba-982a-aa2c97b85ec2 of volume 0bb67c7b-9148-45f3-96cb-71d86c0e6320 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:20:54 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Volume volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a (6d87bffe-7a22-4ae2-950c-5cef7f4f461a): created successfully Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4fa0cbb-3285-4257-985b-a24ebbd3c7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Flow 'volume_create_manager' (9ca0abf6-f6af-4ddb-b51e-5c18a2098529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd6d744-f315-468b-bba8-22a6230116dc]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:54 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c6b389e8-95f5-4c8b-8170-6cfe67eba75b tempest-CreateVolumesFromImageTest-398734887 None] Created volume successfully. Jul 01 04:20:54 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 Jul 01 04:20:54 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "cinder-6d87bffe-7a22-4ae2-950c-5cef7f4f461a-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-6d87bffe-7a22-4ae2-950c-5cef7f4f461a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "cinder-quobyte-6d87bffe-7a22-4ae2-950c-5cef7f4f461a" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-quobyte-6d87bffe-7a22-4ae2-950c-5cef7f4f461a" acquired by "delete_volume" :: waited 0.022s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e6022d-5569-447a-9df8-30a941406c1b]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:54 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a Jul 01 04:20:54 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:54 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320" returned: 0 in 0.771s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:54 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 1G Jul 01 04:20:54 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:55 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a" returned: 0 in 0.779s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:55 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a Jul 01 04:20:55 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:55 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 1G" returned: 0 in 0.807s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:55 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 Jul 01 04:20:55 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:56 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-6d87bffe-7a22-4ae2-950c-5cef7f4f461a" returned: 0 in 0.670s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:56 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-quobyte-6d87bffe-7a22-4ae2-950c-5cef7f4f461a" released by "delete_volume" :: held 1.492s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:20:56 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Created reservations ['e3ca7660-1035-45f3-bcfa-39f90b1c4724', '2e4c4805-0a94-431e-af8a-54a9b600ad4a', '5add9b96-9ecf-4154-8a6e-291cfc2a799d', '4af1cbf2-a8a2-4978-8acc-0727de65ee06'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:20:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:56 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:56 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:20:56 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:56 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2" returned: 0 in 0.740s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:56 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 is being set with open permissions: ugo+rw Jul 01 04:20:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:56 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 Jul 01 04:20:56 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "cinder-9f49406d-7300-4d15-8105-a38effc8f663-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:20:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-9f49406d-7300-4d15-8105-a38effc8f663-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:20:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "cinder-quobyte-9f49406d-7300-4d15-8105-a38effc8f663" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:20:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-quobyte-9f49406d-7300-4d15-8105-a38effc8f663" acquired by "delete_volume" :: waited 0.015s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:20:57 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.679s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:57 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:20:57 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Deleted volume successfully. Jul 01 04:20:57 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea70ff3a-c1f3-4fff-87e9-d0092e21e8f8]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:20:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f49406d-7300-4d15-8105-a38effc8f663 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-e027474a-9091-48a9-88b8-04b50205bcde tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-6d87bffe-7a22-4ae2-950c-5cef7f4f461a-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:20:57 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2" returned: 0 in 0.709s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:57 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f49406d-7300-4d15-8105-a38effc8f663 Jul 01 04:20:57 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:57 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.info Jul 01 04:20:57 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:57 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f49406d-7300-4d15-8105-a38effc8f663" returned: 0 in 0.805s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f49406d-7300-4d15-8105-a38effc8f663 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:57 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:57 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f49406d-7300-4d15-8105-a38effc8f663 Jul 01 04:20:57 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.info" returned: 0 in 0.679s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:57 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.info is being set with open permissions: ugo+rw Jul 01 04:20:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:57 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.info Jul 01 04:20:57 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:58 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9f49406d-7300-4d15-8105-a38effc8f663" returned: 0 in 0.666s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:58 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.info" returned: 0 in 0.648s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.486s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-quobyte-9f49406d-7300-4d15-8105-a38effc8f663" released by "delete_volume" :: held 1.546s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.729s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29ad0b2-7b07-4080-aacf-99ed8a56ca91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2456f922c8144a999c73aebfbbc7ba72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:46Z,use_quota=True,user_id='b9d2bb3bbb5447218a0cb21e941c3750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e10d39c-bdb4-409f-a150-61a951ba9307),volume_type_id=7e10d39c-bdb4-409f-a150-61a951ba9307)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Creating volume a29ad0b2-7b07-4080-aacf-99ed8a56ca91 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:20:58 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:58 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 1073741824 Jul 01 04:20:58 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:58 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-746f3b30-8465-44a6-a0f0-d619cd460801 tempest-VolumeDependencyTests-1223103193 None] Create snapshot completed successfully Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Created reservations ['ec2a2f4b-a5b0-4ad6-a64b-2d41164a6035', '6464a89e-ce6d-4f71-96f2-30a7f89bcb58', '1a2a65bd-d005-45ce-9c21-0b14bdaaeefc', 'c8d18340-f43e-4293-afb7-2867a1618242'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:20:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:58 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:20:58 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "cinder-d7aabff6-6c80-422c-a0f5-076e1030985d-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-d7aabff6-6c80-422c-a0f5-076e1030985d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "cinder-quobyte-d7aabff6-6c80-422c-a0f5-076e1030985d" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-quobyte-d7aabff6-6c80-422c-a0f5-076e1030985d" acquired by "delete_volume" :: waited 0.033s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3954933-05a0-4bb2-835c-56525803ed9f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7aabff6-6c80-422c-a0f5-076e1030985d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:59 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7aabff6-6c80-422c-a0f5-076e1030985d Jul 01 04:20:59 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:59 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.839s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:20:59 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Deleted volume successfully. Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-376fd0a7-a7e1-4a33-8c9e-6a7dec0a8170 tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-9f49406d-7300-4d15-8105-a38effc8f663-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:20:59 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 1073741824" returned: 0 in 1.072s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:20:59 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 Jul 01 04:20:59 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Flow 'volume_create_manager' (1e9974b5-e35e-4119-90a6-794bd301b6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3211801c-bdeb-40c6-bda6-c2f71949d978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3211801c-bdeb-40c6-bda6-c2f71949d978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-417826158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ed313e-8886-4ced-92be-04304ce785c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480307c20e4c46d886f457ddc8fdd7fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2a0be507-94c8-4dba-982a-aa2c97b85ec2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:00Z,use_quota=True,user_id='706e2dbd032c431683d7ba17c88f49ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82be6d81-38b5-4654-97a6-6578287a7558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82be6d81-38b5-4654-97a6-6578287a7558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba243133-dc53-4e33-847d-5f66a19b559f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba243133-dc53-4e33-847d-5f66a19b559f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c5ed313e-8886-4ced-92be-04304ce785c6', 'volume_name': 'volume-c5ed313e-8886-4ced-92be-04304ce785c6', 'volume_size': 1, 'snapshot_id': '2a0be507-94c8-4dba-982a-aa2c97b85ec2'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb2fb7b-4991-4237-864a-d2c3ecaace9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb2fb7b-4991-4237-864a-d2c3ecaace9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee82774-0e00-4a15-84fd-ef20eda2b894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:20:59 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Volume c5ed313e-8886-4ced-92be-04304ce785c6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c5ed313e-8886-4ced-92be-04304ce785c6', 'volume_size': 1, 'snapshot_id': '2a0be507-94c8-4dba-982a-aa2c97b85ec2'} Jul 01 04:20:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:00 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7aabff6-6c80-422c-a0f5-076e1030985d" returned: 0 in 0.849s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7aabff6-6c80-422c-a0f5-076e1030985d {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:00 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7aabff6-6c80-422c-a0f5-076e1030985d Jul 01 04:21:00 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:00 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91" returned: 0 in 0.681s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.205s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:20:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-231616733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924d99ef-ce8d-4911-a726-f89db5d47648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ff6cee37d948b687a1dcc3ee6bba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:20:52Z,use_quota=True,user_id='13194def4b8345208064b66b1f27cdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Creating volume 924d99ef-ce8d-4911-a726-f89db5d47648 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:21:00 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:00 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648 1073741824 Jul 01 04:21:00 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Attempting download of 594ac494-78df-4c3b-8514-fbcd0c78d9e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/594ac494-78df-4c3b-8514-fbcd0c78d9e6', 'metadata': {}}])) to volume a29ad0b2-7b07-4080-aacf-99ed8a56ca91. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41766a2-3a85-4cc3-822e-17b0148add42]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594ac494-78df-4c3b-8514-fbcd0c78d9e6_6acltju8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:00 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594ac494-78df-4c3b-8514-fbcd0c78d9e6_6acltju8 Jul 01 04:21:00 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:00 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d7aabff6-6c80-422c-a0f5-076e1030985d" returned: 0 in 0.682s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-quobyte-d7aabff6-6c80-422c-a0f5-076e1030985d" released by "delete_volume" :: held 1.577s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Created reservations ['38cfb550-cba5-4ba7-9db4-2dd35979c2c9', 'ef7d0360-f597-4fcc-903e-a19136257101', '9c473eb0-71ee-4bd8-ae80-f5a18c6922fd', 'd963f3ce-a1ea-46d3-8cff-b400404a2745'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:01 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:01 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:01 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594ac494-78df-4c3b-8514-fbcd0c78d9e6_6acltju8" returned: 0 in 0.764s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594ac494-78df-4c3b-8514-fbcd0c78d9e6_6acltju8 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:01 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648 1073741824" returned: 0 in 0.944s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:01 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594ac494-78df-4c3b-8514-fbcd0c78d9e6_6acltju8 Jul 01 04:21:01 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:01 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648 Jul 01 04:21:01 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "cinder-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "cinder-quobyte-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-quobyte-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc" acquired by "delete_volume" :: waited 0.032s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9807095e-ca35-46e6-9dc4-f624de5146ea]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:01 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc Jul 01 04:21:01 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:01 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.778s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:01 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Deleted volume successfully. Jul 01 04:21:01 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-a3c253ff-c85f-45d2-99f8-44c3ac4d07ec tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-d7aabff6-6c80-422c-a0f5-076e1030985d-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:02 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648" returned: 0 in 0.705s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.234s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "cinder-quobyte-2a0be507-94c8-4dba-982a-aa2c97b85ec2-c5ed313e-8886-4ced-92be-04304ce785c6" by "_create_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:02 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1bc04b-fc5a-4393-bf9d-1f6455da8cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-924d99ef-ce8d-4911-a726-f89db5d47648', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b609b09d-9fa4-4153-ab95-31a8af2783b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-quobyte-2a0be507-94c8-4dba-982a-aa2c97b85ec2-c5ed313e-8886-4ced-92be-04304ce785c6" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Creating volume c5ed313e-8886-4ced-92be-04304ce785c6 from snapshot 2a0be507-94c8-4dba-982a-aa2c97b85ec2 {{(pid=86177) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "cinder-quobyte-c5ed313e-8886-4ced-92be-04304ce785c6" by "_copy_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594ac494-78df-4c3b-8514-fbcd0c78d9e6_6acltju8" returned: 1 in 0.855s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594ac494-78df-4c3b-8514-fbcd0c78d9e6_6acltju8' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af02cf4-95cc-413b-921c-3d7cb1050310]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:02 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Volume volume-924d99ef-ce8d-4911-a726-f89db5d47648 (924d99ef-ce8d-4911-a726-f89db5d47648): created successfully Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b609b09d-9fa4-4153-ab95-31a8af2783b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Flow 'volume_create_manager' (91b10f00-c028-4d8e-ba65-236ab2aa9ded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-quobyte-c5ed313e-8886-4ced-92be-04304ce785c6" acquired by "_copy_volume_from_snapshot" :: waited 0.061s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] snapshot: 2a0be507-94c8-4dba-982a-aa2c97b85ec2, volume: c5ed313e-8886-4ced-92be-04304ce785c6, {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 04:21:02 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-e9f9f44a-61a1-45b2-9c9b-79b3c4069ccb tempest-CinderUnicodeTest-372545438 None] Created volume successfully. Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:02 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD Jul 01 04:21:02 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba96a67-8c99-44e8-9851-ae2cf9c5085c]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:02 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 Jul 01 04:21:02 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:02 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc" returned: 0 in 0.848s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:02 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:02 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc Jul 01 04:21:02 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:03 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD" returned: 0 in 0.819s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:03 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD Jul 01 04:21:03 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:03 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2" returned: 0 in 0.870s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Creating direct copy from snapshot {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[43006643-496f-4a7e-a761-4ae028c27624]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:03 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 Jul 01 04:21:03 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:03 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc" returned: 0 in 0.744s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-quobyte-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc" released by "delete_volume" :: held 1.665s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Created reservations ['271d79c5-a204-4122-8faf-6c2e2056c9ad', '3aec3290-626c-4bbd-bd94-bf1bacae458b', 'c719f58e-6982-40ef-a381-4de08db7b110', '9b8cea28-804b-41b6-82ed-5dadf925e702'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:03 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:03 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:03 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD" returned: 1 in 0.779s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] 594ac494-78df-4c3b-8514-fbcd0c78d9e6 was raw, converting to raw {{(pid=86177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:03 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 Jul 01 04:21:03 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "cinder-b35d3f70-e97b-4b49-b062-06eb0ad2e819-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:03 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-b35d3f70-e97b-4b49-b062-06eb0ad2e819-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "cinder-quobyte-b35d3f70-e97b-4b49-b062-06eb0ad2e819" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-quobyte-b35d3f70-e97b-4b49-b062-06eb0ad2e819" acquired by "delete_volume" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:04 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a538f056-b622-4914-b088-1f9415c380ef]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:04 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320" returned: 0 in 0.920s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:04 devstack cinder-volume[86177]: DEBUG cinder.utils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Path /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5ed313e-8886-4ced-92be-04304ce785c6 not found in is_blk_device check {{(pid=86177) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 04:21:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5ed313e-8886-4ced-92be-04304ce785c6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:04 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5ed313e-8886-4ced-92be-04304ce785c6 Jul 01 04:21:04 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:04 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819 Jul 01 04:21:04 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:04 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.741s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:04 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:04 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Deleted volume successfully. Jul 01 04:21:04 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-4c79f012-4b65-41d9-98c3-ff9b2f946298 tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-3c7fc7dc-c5d7-460a-9a30-d1ecedfb63cc-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:04 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91" returned: 0 in 0.855s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:04 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_594ac494-78df-4c3b-8514-fbcd0c78d9e6_z9e52feldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:21:04 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Converted 0.00 MB image at 0.00 MB/s Jul 01 04:21:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:04 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 1G Jul 01 04:21:04 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:04 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819" returned: 0 in 0.812s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:04 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:04 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819 Jul 01 04:21:04 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:05 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 1G" returned: 0 in 1.208s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:05 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a31d0c-a2aa-429c-8c24-ef9079d66666]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:06 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 Jul 01 04:21:06 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:06 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-b35d3f70-e97b-4b49-b062-06eb0ad2e819" returned: 0 in 1.706s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-quobyte-b35d3f70-e97b-4b49-b062-06eb0ad2e819" released by "delete_volume" :: held 2.603s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:06 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Created reservations ['2688ba0a-0358-4d2c-a865-29c1116e4689', '5d721305-591c-4a9e-80cb-48540561d30a', '6c5074e5-5dd8-40da-a659-813f3deb7395', '1a4c5462-6366-489f-83cb-1493ca8eb700'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:07 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:07 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:07 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:07 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:08 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 1.299s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:08 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:08 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Deleted volume successfully. Jul 01 04:21:08 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7702033d-dc94-4872-a332-1edfebd1e033 tempest-CreateVolumesFromImageTest-398734887 None] Lock "cinder-b35d3f70-e97b-4b49-b062-06eb0ad2e819-delete_volume" released by "delete_volume" :: held 4.438s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:08 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91" returned: 0 in 2.642s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:08 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 Jul 01 04:21:08 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:10 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91" returned: 1 in 1.456s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:21:10 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Downloaded image 594ac494-78df-4c3b-8514-fbcd0c78d9e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/594ac494-78df-4c3b-8514-fbcd0c78d9e6', 'metadata': {}}])) to volume a29ad0b2-7b07-4080-aacf-99ed8a56ca91 successfully. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 04:21:10 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Temporary image 594ac494-78df-4c3b-8514-fbcd0c78d9e6 for user b9d2bb3bbb5447218a0cb21e941c3750 is deleted. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 04:21:10 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Marking volume a29ad0b2-7b07-4080-aacf-99ed8a56ca91 as bootable. {{(pid=86177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 04:21:10 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Copying metadata from image 594ac494-78df-4c3b-8514-fbcd0c78d9e6 to a29ad0b2-7b07-4080-aacf-99ed8a56ca91. {{(pid=86177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 04:21:10 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Creating volume glance metadata for volume a29ad0b2-7b07-4080-aacf-99ed8a56ca91 backed by image 594ac494-78df-4c3b-8514-fbcd0c78d9e6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '594ac494-78df-4c3b-8514-fbcd0c78d9e6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '694f85b96dd46bdca6299658584c4dea', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 04:21:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e339cf8-0309-49c4-a728-b6b3cc3c9f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91', 'volume_size': 1, 'image_id': '594ac494-78df-4c3b-8514-fbcd0c78d9e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594ac494-78df-4c3b-8514-fbcd0c78d9e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '694f85b96dd46bdca6299658584c4dea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2456f922c8144a999c73aebfbbc7ba72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd953a691c3838a6cf8cb7c2b7eaaaf94e0d6c39c388a854ec4a98a7a0b1b672621c88b44ac885c5ee33b968bfc3e95aa51fb04ebe9605473825bdf3d72a04830', 'id': '594ac494-78df-4c3b-8514-fbcd0c78d9e6', 'created_at': datetime.datetime(2026, 7, 1, 2, 20, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 2, 20, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594ac494-78df-4c3b-8514-fbcd0c78d9e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bbd170-2d2f-478d-8224-a31ac7652bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:10 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Volume volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 (a29ad0b2-7b07-4080-aacf-99ed8a56ca91): created successfully Jul 01 04:21:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bbd170-2d2f-478d-8224-a31ac7652bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Flow 'volume_create_manager' (8e01974d-f562-412b-9f22-f1de9d62c46b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:10 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-696f2c90-8707-468d-9641-6cf7e4d7214c tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Created volume successfully. Jul 01 04:21:10 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5ed313e-8886-4ced-92be-04304ce785c6" returned: 0 in 6.109s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:10 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[301c034a-4b93-4ad4-8e3b-c3c3da3f5904]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:10 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 Jul 01 04:21:10 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:11 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320" returned: 0 in 0.993s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:11 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Image conversion details: src /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5ed313e-8886-4ced-92be-04304ce785c6 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:21:11 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Converted 1024.00 MB image at 167.59 MB/s Jul 01 04:21:11 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5ed313e-8886-4ced-92be-04304ce785c6 is being set with open permissions: ugo+rw Jul 01 04:21:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5ed313e-8886-4ced-92be-04304ce785c6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:11 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5ed313e-8886-4ced-92be-04304ce785c6 Jul 01 04:21:11 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Acquiring lock "cinder-a29ad0b2-7b07-4080-aacf-99ed8a56ca91-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Lock "cinder-a29ad0b2-7b07-4080-aacf-99ed8a56ca91-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Acquiring lock "cinder-quobyte-a29ad0b2-7b07-4080-aacf-99ed8a56ca91" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Lock "cinder-quobyte-a29ad0b2-7b07-4080-aacf-99ed8a56ca91" acquired by "delete_volume" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:11 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a68228-9549-4f91-9cb9-82ec7d6a7868]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:11 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 Jul 01 04:21:11 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:11 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5ed313e-8886-4ced-92be-04304ce785c6" returned: 0 in 0.701s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-quobyte-c5ed313e-8886-4ced-92be-04304ce785c6" released by "_copy_volume_from_snapshot" :: held 9.740s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-quobyte-2a0be507-94c8-4dba-982a-aa2c97b85ec2-c5ed313e-8886-4ced-92be-04304ce785c6" released by "_create_volume_from_snapshot" :: held 9.824s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.863s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.804s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] Creating offline snapshot 29b0f787-cb94-40cd-a41c-d35ae531dd3e of volume 924d99ef-ce8d-4911-a726-f89db5d47648 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee82774-0e00-4a15-84fd-ef20eda2b894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ed313e-8886-4ced-92be-04304ce785c6', 'volume_size': 1, 'snapshot_id': '2a0be507-94c8-4dba-982a-aa2c97b85ec2'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e09a18-a777-4aa3-9ebf-3b0dd63044e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bcc9ce-5efd-4d6d-9c93-048753714a70]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:12 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Volume volume-c5ed313e-8886-4ced-92be-04304ce785c6 (c5ed313e-8886-4ced-92be-04304ce785c6): created successfully Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e09a18-a777-4aa3-9ebf-3b0dd63044e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Flow 'volume_create_manager' (1e9974b5-e35e-4119-90a6-794bd301b6a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:12 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-634b47f7-f976-41c6-a2be-13de532e9231 tempest-VolumeDependencyTests-1223103193 None] Created volume successfully. Jul 01 04:21:12 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648 Jul 01 04:21:12 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:12 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91" returned: 0 in 0.845s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:12 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 Jul 01 04:21:12 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Flow 'volume_create_manager' (054eb63b-52e3-45ca-9160-fd480b3d665a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16de4961-6d90-4ccd-b47e-1c759c6e03a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16de4961-6d90-4ccd-b47e-1c759c6e03a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-264260978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bfac725-3d1d-417c-b8f5-f19cce323d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18d61d06c5447fab36bb06391847a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:12Z,use_quota=True,user_id='1d7bb4dbe9ed4a5e9d26d5b570c65469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3a23f1-59c2-40e1-a765-09a99027012c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3a23f1-59c2-40e1-a765-09a99027012c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81c80e5-2ebf-42b2-989a-c1e5ac636089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81c80e5-2ebf-42b2-989a-c1e5ac636089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bfac725-3d1d-417c-b8f5-f19cce323d2a', 'volume_name': 'volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad279cd-45de-4694-b9a0-82b75b610295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad279cd-45de-4694-b9a0-82b75b610295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9148e15-e162-4a1c-80cf-5d35280ae773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:12 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume 2bfac725-3d1d-417c-b8f5-f19cce323d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a', 'volume_size': 1} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:12 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648" returned: 0 in 0.849s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:12 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e 1G Jul 01 04:21:12 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:13 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "cinder-2a0be507-94c8-4dba-982a-aa2c97b85ec2-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91" returned: 1 in 0.768s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:13 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91 Jul 01 04:21:13 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-2a0be507-94c8-4dba-982a-aa2c97b85ec2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "cinder-quobyte-0bb67c7b-9148-45f3-96cb-71d86c0e6320" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-quobyte-0bb67c7b-9148-45f3-96cb-71d86c0e6320" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "cinder-quobyte-2a0be507-94c8-4dba-982a-aa2c97b85ec2" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-quobyte-2a0be507-94c8-4dba-982a-aa2c97b85ec2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Deleting offline snapshot 2a0be507-94c8-4dba-982a-aa2c97b85ec2 of volume 0bb67c7b-9148-45f3-96cb-71d86c0e6320 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] snapshot_file for this snap is: volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8131ab48-ba71-4083-9291-9861eea5da3d]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:13 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 Jul 01 04:21:13 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:13 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e 1G" returned: 0 in 0.850s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-924d99ef-ce8d-4911-a726-f89db5d47648 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:13 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-a29ad0b2-7b07-4080-aacf-99ed8a56ca91" returned: 0 in 0.707s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:13 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-924d99ef-ce8d-4911-a726-f89db5d47648 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e Jul 01 04:21:13 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Lock "cinder-quobyte-a29ad0b2-7b07-4080-aacf-99ed8a56ca91" released by "delete_volume" :: held 2.389s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Created reservations ['d732ddf2-bf1a-4ee5-a12c-dfd990eb8505', 'c16a80b4-85e2-4edd-81b4-7c7137d6cc80', 'c8108122-2853-4d8b-9f9e-bb3bdcf2c9a5', '93f7d431-12bf-490b-af0f-d7ea37bc3ef1'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:13 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:13 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:14 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2" returned: 0 in 0.837s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:21:14 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef1d0f1-fd3d-4539-9e5d-b9256beb0486]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:14 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 Jul 01 04:21:14 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:14 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-924d99ef-ce8d-4911-a726-f89db5d47648 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e" returned: 0 in 0.744s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:14 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e is being set with open permissions: ugo+rw Jul 01 04:21:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:14 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e Jul 01 04:21:14 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:14 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.784s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:14 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:14 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Deleted volume successfully. Jul 01 04:21:14 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ff12066d-3b2c-4b02-8682-2f94f26bf308 tempest-VolumeAndVolumeTypeFromImageTest-443728004 None] Lock "cinder-a29ad0b2-7b07-4080-aacf-99ed8a56ca91-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:14 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320" returned: 0 in 0.836s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:14 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 Jul 01 04:21:14 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:15 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e" returned: 0 in 0.707s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:15 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.info Jul 01 04:21:15 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:15 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2" returned: 0 in 0.784s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:15 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2 Jul 01 04:21:15 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:15 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.info" returned: 0 in 0.690s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:15 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.info is being set with open permissions: ugo+rw Jul 01 04:21:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:15 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.info Jul 01 04:21:16 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:16 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320.2a0be507-94c8-4dba-982a-aa2c97b85ec2" returned: 0 in 0.751s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-quobyte-2a0be507-94c8-4dba-982a-aa2c97b85ec2" released by "_delete_snapshot" :: held 3.313s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-quobyte-0bb67c7b-9148-45f3-96cb-71d86c0e6320" released by "delete_snapshot" :: held 3.335s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Created reservations ['1a466175-afd2-410c-a72f-5dadeeaa081a', '389fc1ec-9b5e-4165-9edb-e23a0df063af', 'f9ef0f4b-0c9d-491a-a0bd-dd0dbe9b112b', 'b5c0e20d-4404-47d6-997d-600a8021bb4e'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:16 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Delete snapshot completed successfully. Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d3664fcf-b537-4735-b2a2-9ac981b5c8fa tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-2a0be507-94c8-4dba-982a-aa2c97b85ec2-delete_snapshot" released by "delete_snapshot" :: held 3.536s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:16 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.info" returned: 0 in 0.757s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.726s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.192s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-264260978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bfac725-3d1d-417c-b8f5-f19cce323d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18d61d06c5447fab36bb06391847a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:12Z,use_quota=True,user_id='1d7bb4dbe9ed4a5e9d26d5b570c65469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Creating volume 2bfac725-3d1d-417c-b8f5-f19cce323d2a {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:21:16 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:21:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:16 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a 1073741824 Jul 01 04:21:16 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:16 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c7df66ea-500b-4a1c-ac5f-37ce0f3dbeb4 tempest-CinderUnicodeTest-372545438 None] Create snapshot completed successfully Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Acquiring lock "cinder-29b0f787-cb94-40cd-a41c-d35ae531dd3e-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Lock "cinder-29b0f787-cb94-40cd-a41c-d35ae531dd3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Acquiring lock "cinder-quobyte-924d99ef-ce8d-4911-a726-f89db5d47648" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Lock "cinder-quobyte-924d99ef-ce8d-4911-a726-f89db5d47648" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Acquiring lock "cinder-quobyte-29b0f787-cb94-40cd-a41c-d35ae531dd3e" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Lock "cinder-quobyte-29b0f787-cb94-40cd-a41c-d35ae531dd3e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Deleting offline snapshot 29b0f787-cb94-40cd-a41c-d35ae531dd3e of volume 924d99ef-ce8d-4911-a726-f89db5d47648 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] snapshot_file for this snap is: volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c349fd1-0657-4b53-a9af-869b56fa431a]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:17 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e Jul 01 04:21:17 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "cinder-0bb67c7b-9148-45f3-96cb-71d86c0e6320-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-0bb67c7b-9148-45f3-96cb-71d86c0e6320-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "cinder-quobyte-0bb67c7b-9148-45f3-96cb-71d86c0e6320" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-quobyte-0bb67c7b-9148-45f3-96cb-71d86c0e6320" acquired by "delete_volume" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bd8cab-bf0e-49e8-ba7d-47024c331f23]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:17 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 Jul 01 04:21:17 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:17 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a 1073741824" returned: 0 in 1.073s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:17 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a Jul 01 04:21:17 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:18 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e" returned: 0 in 1.072s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-924d99ef-ce8d-4911-a726-f89db5d47648(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:21:18 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf4e2d3-a1f8-4f64-9c51-428d0c40f772]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:18 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648 Jul 01 04:21:18 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:18 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320" returned: 0 in 1.020s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:18 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320 Jul 01 04:21:18 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:18 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a" returned: 0 in 0.794s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:18 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:21:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9148e15-e162-4a1c-80cf-5d35280ae773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087e98b5-dd50-4778-8b93-054f9cb950c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:18 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a (2bfac725-3d1d-417c-b8f5-f19cce323d2a): created successfully Jul 01 04:21:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087e98b5-dd50-4778-8b93-054f9cb950c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:18 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Flow 'volume_create_manager' (054eb63b-52e3-45ca-9160-fd480b3d665a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:18 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-ace11d3f-cfa6-470a-9260-e105db778def tempest-CreateVolumesFromSnapshotTest-1730465588 None] Created volume successfully. Jul 01 04:21:19 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648" returned: 0 in 0.870s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:19 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e Jul 01 04:21:19 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:19 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-0bb67c7b-9148-45f3-96cb-71d86c0e6320" returned: 0 in 0.693s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-quobyte-0bb67c7b-9148-45f3-96cb-71d86c0e6320" released by "delete_volume" :: held 1.778s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Created reservations ['95d50e41-644e-4510-8a43-3b395c5b3779', '66bfee9d-e124-4422-976f-a3a4996a21da', 'f9814d6a-a59f-416d-b51a-03c79cd74405', 'b4784200-802c-4cf6-9d8f-6f7304978e67'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:19 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:19 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "cinder-c5ed313e-8886-4ced-92be-04304ce785c6-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-c5ed313e-8886-4ced-92be-04304ce785c6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "cinder-quobyte-c5ed313e-8886-4ced-92be-04304ce785c6" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-quobyte-c5ed313e-8886-4ced-92be-04304ce785c6" acquired by "delete_volume" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e3399c-cb4d-413a-802d-ee6003d70440]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5ed313e-8886-4ced-92be-04304ce785c6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:20 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5ed313e-8886-4ced-92be-04304ce785c6 Jul 01 04:21:20 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:20 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e" returned: 0 in 0.957s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:20 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e Jul 01 04:21:20 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:20 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.827s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:20 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Creating offline snapshot 15d81b34-577d-4546-af3b-a2fce54a2df5 of volume 2bfac725-3d1d-417c-b8f5-f19cce323d2a {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:21:20 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Deleted volume successfully. Jul 01 04:21:20 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13baf7c-fe50-4f37-9fee-71eeac7b407e]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-bb87ed37-3410-4b5f-a65d-6d9c6e73ed55 tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-0bb67c7b-9148-45f3-96cb-71d86c0e6320-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:20 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a Jul 01 04:21:20 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:20 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5ed313e-8886-4ced-92be-04304ce785c6" returned: 0 in 0.953s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5ed313e-8886-4ced-92be-04304ce785c6 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:20 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5ed313e-8886-4ced-92be-04304ce785c6 Jul 01 04:21:20 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:20 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648.29b0f787-cb94-40cd-a41c-d35ae531dd3e" returned: 0 in 0.799s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Lock "cinder-quobyte-29b0f787-cb94-40cd-a41c-d35ae531dd3e" released by "_delete_snapshot" :: held 3.871s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Lock "cinder-quobyte-924d99ef-ce8d-4911-a726-f89db5d47648" released by "delete_snapshot" :: held 3.904s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Created reservations ['543d2f24-c656-4e49-8cb8-0f98e55a19b6', 'a5afb600-e934-4cbe-aac1-b17f4406833d', 'b55f6913-6a12-4fe2-b269-4270fd0696a6', '641bc2bb-1401-479f-8dc7-826ed99641ef'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:21 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Delete snapshot completed successfully. Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-149f5bf6-0b08-4fac-a0b3-e9447bf21152 tempest-CinderUnicodeTest-372545438 None] Lock "cinder-29b0f787-cb94-40cd-a41c-d35ae531dd3e-delete_snapshot" released by "delete_snapshot" :: held 4.060s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:21 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a" returned: 0 in 0.906s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:21 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5 1G Jul 01 04:21:21 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Acquiring lock "cinder-924d99ef-ce8d-4911-a726-f89db5d47648-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Lock "cinder-924d99ef-ce8d-4911-a726-f89db5d47648-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Acquiring lock "cinder-quobyte-924d99ef-ce8d-4911-a726-f89db5d47648" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Lock "cinder-quobyte-924d99ef-ce8d-4911-a726-f89db5d47648" acquired by "delete_volume" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc454d3-e75b-48db-b64e-433fb75382a2]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:21 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-c5ed313e-8886-4ced-92be-04304ce785c6" returned: 0 in 0.757s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-quobyte-c5ed313e-8886-4ced-92be-04304ce785c6" released by "delete_volume" :: held 1.758s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:21 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648 Jul 01 04:21:21 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Created reservations ['e313fd73-bf08-40ca-b3e1-815dfac9e61f', '6f4b79c0-5215-46d6-a4df-0db9db75afea', '43bf9255-9dc3-4ed5-85de-480a607e65cb', '395d8b48-c3e5-4acd-b01e-a8441d50310f'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:21 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:21 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:22 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5 1G" returned: 0 in 0.965s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:22 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5 Jul 01 04:21:22 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:22 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.798s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:22 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:22 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Deleted volume successfully. Jul 01 04:21:22 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648" returned: 0 in 1.091s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:22 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-7d9bdd56-3741-410a-bbda-413177bffef4 tempest-VolumeDependencyTests-1223103193 None] Lock "cinder-c5ed313e-8886-4ced-92be-04304ce785c6-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:22 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648 Jul 01 04:21:22 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:23 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5" returned: 0 in 0.963s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:23 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5 is being set with open permissions: ugo+rw Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:23 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5 Jul 01 04:21:23 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Flow 'volume_create_manager' (7a287a06-66ca-43e8-93bb-2782d361aa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564611b3-b7cf-4b10-9baa-5d8e47ccbebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564611b3-b7cf-4b10-9baa-5d8e47ccbebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63d3bdb-2556-44dc-9d13-efbc3aa2db29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fabd4b897d14233817db2ba244a5f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:23Z,use_quota=True,user_id='2a92ab135d1e4c4780bb900f8f1484e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a8ee59-09ce-4d17-9518-5995335407f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a8ee59-09ce-4d17-9518-5995335407f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286f0e8d-e48e-4b20-bf0e-4a9d8e104143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.image.glance [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Creating Keystone auth plugin from conf {{(pid=86177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 01 04:21:23 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-924d99ef-ce8d-4911-a726-f89db5d47648" returned: 0 in 0.808s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Lock "cinder-quobyte-924d99ef-ce8d-4911-a726-f89db5d47648" released by "delete_volume" :: held 1.972s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Created reservations ['fc7e1c37-4133-460c-bafc-e3cac9ec3634', '703563c2-b89c-41f7-9c00-13bbf2d25600', '31813155-a88f-4a8c-974e-cf906060c3be', 'b544706b-e99b-4808-a6d2-21f794436a91'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:23 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:23 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Acquiring lock "cinder-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Lock "cinder-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Acquiring lock "cinder-quobyte-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Lock "cinder-quobyte-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4" acquired by "delete_volume" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a342d9d0-cbe7-44fb-a557-6a5117893b10]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286f0e8d-e48e-4b20-bf0e-4a9d8e104143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd63d3bdb-2556-44dc-9d13-efbc3aa2db29', 'volume_name': 'volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29', 'volume_size': 1, 'image_id': 'cd3d1578-06fb-4394-a447-fcb3c35bb5c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd3d1578-06fb-4394-a447-fcb3c35bb5c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2d777d6d9387e4be8408a67c4654fc1e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fabd4b897d14233817db2ba244a5f61', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f7855c81515411e89986dc14eaf0fecabf8e53b27bb98ffc0b254eb48ba8123c11dba0edb513ec60978065b7e1a4ced481e49f5c3696d28b2881911d94e52a51', 'id': 'cd3d1578-06fb-4394-a447-fcb3c35bb5c7', 'created_at': datetime.datetime(2026, 7, 1, 2, 21, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 2, 21, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd3d1578-06fb-4394-a447-fcb3c35bb5c7/file', 'properties': {}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3924688f-1788-4238-b291-848189a1893b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3924688f-1788-4238-b291-848189a1893b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f68ee5e-9f9a-40c0-8521-043612f1e595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:23 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Volume d63d3bdb-2556-44dc-9d13-efbc3aa2db29: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29', 'volume_size': 1, 'image_id': 'cd3d1578-06fb-4394-a447-fcb3c35bb5c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd3d1578-06fb-4394-a447-fcb3c35bb5c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2d777d6d9387e4be8408a67c4654fc1e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fabd4b897d14233817db2ba244a5f61', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f7855c81515411e89986dc14eaf0fecabf8e53b27bb98ffc0b254eb48ba8123c11dba0edb513ec60978065b7e1a4ced481e49f5c3696d28b2881911d94e52a51', 'id': 'cd3d1578-06fb-4394-a447-fcb3c35bb5c7', 'created_at': datetime.datetime(2026, 7, 1, 2, 21, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 2, 21, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd3d1578-06fb-4394-a447-fcb3c35bb5c7/file', 'properties': {}}, 'image_service': } Jul 01 04:21:23 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Trying to clone d63d3bdb-2556-44dc-9d13-efbc3aa2db29 from image cd3d1578-06fb-4394-a447-fcb3c35bb5c7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd3d1578-06fb-4394-a447-fcb3c35bb5c7', 'metadata': {}}]). {{(pid=86177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 01 04:21:24 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4 Jul 01 04:21:24 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 01 04:21:24 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Image download 0.00 MB at 0.00 MB/s Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfee0c5-2f6c-47c8-a132-4bd348e0f00e]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:24 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5" returned: 0 in 1.217s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:24 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD Jul 01 04:21:24 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:24 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.938s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:24 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.info Jul 01 04:21:24 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:24 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Deleted volume successfully. Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-28c0162a-4fc6-4a5f-8c9b-1bb99e21ebec tempest-CinderUnicodeTest-372545438 None] Lock "cinder-924d99ef-ce8d-4911-a726-f89db5d47648-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:24 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:24 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:24 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4" returned: 0 in 1.128s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:24 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4 Jul 01 04:21:24 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:25 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD" returned: 0 in 0.864s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:25 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.info" returned: 0 in 0.738s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:25 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.info is being set with open permissions: ugo+rw Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:25 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.716s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:25 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.info Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:21:25 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:21:25 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD Jul 01 04:21:25 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:25 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4" returned: 0 in 0.748s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Lock "cinder-quobyte-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4" released by "delete_volume" :: held 1.938s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Created reservations ['7ef2f91d-6b72-4af0-8626-f20a435d593c', '421e98f9-0476-42c5-897f-94fceb688a52', 'f14b0289-f6de-4226-88a5-3bf81811ee22', 'fde5f288-daa4-47ad-841d-b7f741be8756'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:25 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.info" returned: 0 in 0.677s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:25 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:25 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.648s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:25 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD" returned: 1 in 0.772s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:21:25 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Temporary image cd3d1578-06fb-4394-a447-fcb3c35bb5c7 is fetched for user 2a92ab135d1e4c4780bb900f8f1484e4. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 01 04:21:25 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-dab05700-b3eb-4315-ab94-7f92254e9954 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Create snapshot completed successfully Jul 01 04:21:26 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbd7038-f81e-4d99-950a-74fc4ecd465e]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:26 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD Jul 01 04:21:26 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:26 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.738s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:26 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:26 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Deleted volume successfully. Jul 01 04:21:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-b63d0cb4-0205-431d-89f6-433c57d68925 tempest-CinderUnicodeTest-372545438 None] Lock "cinder-9b77b3b2-eaf8-4768-91dd-2c38fb3003f4-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:26 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:26 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD Jul 01 04:21:26 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Flow 'volume_create_manager' (c616eaa4-61f8-43d4-99ff-38ca9a3d6bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f749dce-aaa8-4562-8d54-a5dd6f881571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f749dce-aaa8-4562-8d54-a5dd6f881571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-18362106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28011b40-87de-4f88-b92a-9f5921cec34b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18d61d06c5447fab36bb06391847a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:27Z,use_quota=True,user_id='1d7bb4dbe9ed4a5e9d26d5b570c65469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea46a42-cc44-4bb3-b725-c83fe4b3cfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea46a42-cc44-4bb3-b725-c83fe4b3cfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235845dd-1bca-4c3d-b461-12c08d999be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235845dd-1bca-4c3d-b461-12c08d999be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28011b40-87de-4f88-b92a-9f5921cec34b', 'volume_name': 'volume-28011b40-87de-4f88-b92a-9f5921cec34b', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5fb365d-8da2-411a-923b-550a20cdfd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5fb365d-8da2-411a-923b-550a20cdfd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0edd30-1c99-4799-a686-5604eab00528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:27 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume 28011b40-87de-4f88-b92a-9f5921cec34b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28011b40-87de-4f88-b92a-9f5921cec34b', 'volume_size': 1} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-18362106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28011b40-87de-4f88-b92a-9f5921cec34b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18d61d06c5447fab36bb06391847a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:27Z,use_quota=True,user_id='1d7bb4dbe9ed4a5e9d26d5b570c65469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Creating volume 28011b40-87de-4f88-b92a-9f5921cec34b {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:21:27 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28011b40-87de-4f88-b92a-9f5921cec34b 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:27 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28011b40-87de-4f88-b92a-9f5921cec34b 1073741824 Jul 01 04:21:27 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Flow 'volume_create_manager' (80d6bcca-410b-464c-8bed-00e7c90eae81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:27 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110fd215-fa43-4761-a06c-e7543a95a02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD" returned: 1 in 0.971s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110fd215-fa43-4761-a06c-e7543a95a02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1125814519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb44eb5-9299-4859-97fd-45e4882303f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18d61d06c5447fab36bb06391847a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:28Z,use_quota=True,user_id='1d7bb4dbe9ed4a5e9d26d5b570c65469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94dda0b-d2bc-489b-9e80-096194a6002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94dda0b-d2bc-489b-9e80-096194a6002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2641ba7d-2027-4b5b-bda2-32709bb1bacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2641ba7d-2027-4b5b-bda2-32709bb1bacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb44eb5-9299-4859-97fd-45e4882303f9', 'volume_name': 'volume-deb44eb5-9299-4859-97fd-45e4882303f9', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9a342b-64a7-4f79-855f-74de58b3a655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9a342b-64a7-4f79-855f-74de58b3a655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f440b97-645e-4481-a941-2e20cc9201b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:27 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume deb44eb5-9299-4859-97fd-45e4882303f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb44eb5-9299-4859-97fd-45e4882303f9', 'volume_size': 1} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:27 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Flow 'volume_create_manager' (b0615390-14ed-4dd1-b3ec-a58db1d6c871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f4a528-5db1-4323-917c-f5aa6ee2e33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f4a528-5db1-4323-917c-f5aa6ee2e33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038258591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75feba61-55dd-44e4-87f1-26dfa7d37514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18d61d06c5447fab36bb06391847a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:28Z,use_quota=True,user_id='1d7bb4dbe9ed4a5e9d26d5b570c65469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010c3787-1825-44c3-9e48-a0e19367fec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010c3787-1825-44c3-9e48-a0e19367fec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63c5cd7-7029-48bb-8a43-c208455c3433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63c5cd7-7029-48bb-8a43-c208455c3433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75feba61-55dd-44e4-87f1-26dfa7d37514', 'volume_name': 'volume-75feba61-55dd-44e4-87f1-26dfa7d37514', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354dad77-1c4d-4640-9ba3-932d7e9c3018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354dad77-1c4d-4640-9ba3-932d7e9c3018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d95e1b5-e766-455a-babf-cd2d6369b621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:28 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume 75feba61-55dd-44e4-87f1-26dfa7d37514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75feba61-55dd-44e4-87f1-26dfa7d37514', 'volume_size': 1} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:28 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Flow 'volume_create_manager' (45e0f666-421a-45d1-a264-40046400c327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (181e159e-6de9-455d-8a1c-15b30142a8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28011b40-87de-4f88-b92a-9f5921cec34b 1073741824" returned: 0 in 1.279s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (181e159e-6de9-455d-8a1c-15b30142a8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-191639131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8fdf62-bb27-4b09-b06e-1b619c1d1975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18d61d06c5447fab36bb06391847a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:28Z,use_quota=True,user_id='1d7bb4dbe9ed4a5e9d26d5b570c65469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c042f1f3-65cf-4a0f-90cd-0e360e319d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c042f1f3-65cf-4a0f-90cd-0e360e319d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630c7b28-0e6d-4593-8e6e-54364f75ea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630c7b28-0e6d-4593-8e6e-54364f75ea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c8fdf62-bb27-4b09-b06e-1b619c1d1975', 'volume_name': 'volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979764d8-8f07-4e34-82c8-50a877e05a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979764d8-8f07-4e34-82c8-50a877e05a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b18a7a-97b8-4ace-9988-c7bb5c64189f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:28 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume 3c8fdf62-bb27-4b09-b06e-1b619c1d1975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975', 'volume_size': 1} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28011b40-87de-4f88-b92a-9f5921cec34b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:28 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28011b40-87de-4f88-b92a-9f5921cec34b Jul 01 04:21:28 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Flow 'volume_create_manager' (218f1a25-2a33-4927-af34-8e479c28f8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93aecc4-30c6-48a9-bf94-db55479e9a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93aecc4-30c6-48a9-bf94-db55479e9a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-527254954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7960591e-d120-4885-8d53-ac5cecfa5bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18d61d06c5447fab36bb06391847a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:29Z,use_quota=True,user_id='1d7bb4dbe9ed4a5e9d26d5b570c65469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8ed9cd-65a7-406c-81fb-6e3bbf947a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8ed9cd-65a7-406c-81fb-6e3bbf947a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:28 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a534ae52-bcf1-45e2-8c95-f95bc329f261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a534ae52-bcf1-45e2-8c95-f95bc329f261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7960591e-d120-4885-8d53-ac5cecfa5bfa', 'volume_name': 'volume-7960591e-d120-4885-8d53-ac5cecfa5bfa', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211429ee-e396-4ac7-a35c-58d55cab808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211429ee-e396-4ac7-a35c-58d55cab808c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72e5805-3f0a-4cae-99f7-868af77b947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:29 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume 7960591e-d120-4885-8d53-ac5cecfa5bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7960591e-d120-4885-8d53-ac5cecfa5bfa', 'volume_size': 1} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:29 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28011b40-87de-4f88-b92a-9f5921cec34b" returned: 0 in 0.738s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.125s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.552s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63d3bdb-2556-44dc-9d13-efbc3aa2db29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fabd4b897d14233817db2ba244a5f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:23Z,use_quota=True,user_id='2a92ab135d1e4c4780bb900f8f1484e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Creating volume d63d3bdb-2556-44dc-9d13-efbc3aa2db29 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:21:29 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0edd30-1c99-4799-a686-5604eab00528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28011b40-87de-4f88-b92a-9f5921cec34b', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4af7c7-f8d1-4a11-b7cc-d1b2889c8d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:29 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 1073741824 Jul 01 04:21:29 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:29 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume volume-28011b40-87de-4f88-b92a-9f5921cec34b (28011b40-87de-4f88-b92a-9f5921cec34b): created successfully Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4af7c7-f8d1-4a11-b7cc-d1b2889c8d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:29 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Flow 'volume_create_manager' (c616eaa4-61f8-43d4-99ff-38ca9a3d6bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:29 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-83a8ee7f-3057-4748-8866-6aa93917626b tempest-CreateVolumesFromSnapshotTest-1730465588 None] Created volume successfully. Jul 01 04:21:30 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 1073741824" returned: 0 in 0.893s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:30 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 Jul 01 04:21:30 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:30 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29" returned: 0 in 0.669s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:21:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.116s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1125814519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb44eb5-9299-4859-97fd-45e4882303f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18d61d06c5447fab36bb06391847a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:28Z,use_quota=True,user_id='1d7bb4dbe9ed4a5e9d26d5b570c65469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:21:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Creating volume deb44eb5-9299-4859-97fd-45e4882303f9 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:21:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:30 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:21:30 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:21:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-deb44eb5-9299-4859-97fd-45e4882303f9 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:31 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-deb44eb5-9299-4859-97fd-45e4882303f9 1073741824 Jul 01 04:21:31 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:31 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Attempting download of cd3d1578-06fb-4394-a447-fcb3c35bb5c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd3d1578-06fb-4394-a447-fcb3c35bb5c7', 'metadata': {}}])) to volume d63d3bdb-2556-44dc-9d13-efbc3aa2db29. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 01 04:21:31 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e8f521-7dfa-4463-9ebf-46715624fdcc]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_1ka8piy1 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:31 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_1ka8piy1 Jul 01 04:21:31 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:31 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_1ka8piy1" returned: 0 in 0.859s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_1ka8piy1 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:31 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-deb44eb5-9299-4859-97fd-45e4882303f9 1073741824" returned: 0 in 0.983s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-deb44eb5-9299-4859-97fd-45e4882303f9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:32 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-deb44eb5-9299-4859-97fd-45e4882303f9 Jul 01 04:21:32 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:32 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_1ka8piy1 Jul 01 04:21:32 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:32 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_1ka8piy1" returned: 1 in 0.767s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_1ka8piy1' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[280b0adf-321b-48c3-97e3-5c0d3f1108f9]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:32 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-deb44eb5-9299-4859-97fd-45e4882303f9" returned: 0 in 0.732s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.666s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038258591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75feba61-55dd-44e4-87f1-26dfa7d37514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18d61d06c5447fab36bb06391847a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:28Z,use_quota=True,user_id='1d7bb4dbe9ed4a5e9d26d5b570c65469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Creating volume 75feba61-55dd-44e4-87f1-26dfa7d37514 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:21:32 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-75feba61-55dd-44e4-87f1-26dfa7d37514 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:32 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-75feba61-55dd-44e4-87f1-26dfa7d37514 1073741824 Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f440b97-645e-4481-a941-2e20cc9201b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb44eb5-9299-4859-97fd-45e4882303f9', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:32 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b42faed-c930-4fcb-a7b4-c5cc36fa76d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:32 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD Jul 01 04:21:32 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:32 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume volume-deb44eb5-9299-4859-97fd-45e4882303f9 (deb44eb5-9299-4859-97fd-45e4882303f9): created successfully Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b42faed-c930-4fcb-a7b4-c5cc36fa76d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:32 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Flow 'volume_create_manager' (80d6bcca-410b-464c-8bed-00e7c90eae81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:32 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-c00ccaed-2c92-4d86-9954-3601218a31c4 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Created volume successfully. Jul 01 04:21:33 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD" returned: 0 in 0.820s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:33 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD Jul 01 04:21:33 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:33 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-75feba61-55dd-44e4-87f1-26dfa7d37514 1073741824" returned: 0 in 0.909s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:33 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-75feba61-55dd-44e4-87f1-26dfa7d37514 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:33 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-75feba61-55dd-44e4-87f1-26dfa7d37514 Jul 01 04:21:33 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:34 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD" returned: 1 in 0.925s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] cd3d1578-06fb-4394-a447-fcb3c35bb5c7 was raw, converting to raw {{(pid=86177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:34 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 Jul 01 04:21:34 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:34 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-75feba61-55dd-44e4-87f1-26dfa7d37514" returned: 0 in 0.844s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.027s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-191639131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8fdf62-bb27-4b09-b06e-1b619c1d1975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18d61d06c5447fab36bb06391847a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:28Z,use_quota=True,user_id='1d7bb4dbe9ed4a5e9d26d5b570c65469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Creating volume 3c8fdf62-bb27-4b09-b06e-1b619c1d1975 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:21:34 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d95e1b5-e766-455a-babf-cd2d6369b621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75feba61-55dd-44e4-87f1-26dfa7d37514', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:34 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975 1073741824 Jul 01 04:21:34 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932b5242-d642-40da-8aa8-36f30bdff0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:34 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume volume-75feba61-55dd-44e4-87f1-26dfa7d37514 (75feba61-55dd-44e4-87f1-26dfa7d37514): created successfully Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932b5242-d642-40da-8aa8-36f30bdff0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:34 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Flow 'volume_create_manager' (b0615390-14ed-4dd1-b3ec-a58db1d6c871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:34 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-bc71753b-eab2-47de-af1b-ada780e90123 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Created volume successfully. Jul 01 04:21:35 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29" returned: 0 in 1.004s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:35 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd3d1578-06fb-4394-a447-fcb3c35bb5c7_7iuahrbbdevstack@QuobyteHD, size 0.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:21:35 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Converted 0.00 MB image at 0.00 MB/s Jul 01 04:21:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:35 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 1G Jul 01 04:21:35 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:35 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975 1073741824" returned: 0 in 1.164s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:35 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:35 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975 Jul 01 04:21:35 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:36 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 1G" returned: 0 in 0.866s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf04fe5-d2db-4dca-9c64-df54c58800cf]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:36 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 Jul 01 04:21:36 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:36 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975" returned: 0 in 0.905s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.721s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-527254954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7960591e-d120-4885-8d53-ac5cecfa5bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18d61d06c5447fab36bb06391847a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:29Z,use_quota=True,user_id='1d7bb4dbe9ed4a5e9d26d5b570c65469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Creating volume 7960591e-d120-4885-8d53-ac5cecfa5bfa {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:21:36 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7960591e-d120-4885-8d53-ac5cecfa5bfa 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b18a7a-97b8-4ace-9988-c7bb5c64189f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:36 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7960591e-d120-4885-8d53-ac5cecfa5bfa 1073741824 Jul 01 04:21:36 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83dec371-bd69-4bdf-8fa8-fb3acef581ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:36 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975 (3c8fdf62-bb27-4b09-b06e-1b619c1d1975): created successfully Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83dec371-bd69-4bdf-8fa8-fb3acef581ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:36 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Flow 'volume_create_manager' (45e0f666-421a-45d1-a264-40046400c327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:36 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-9540d8ea-6f01-40c9-beb6-3177174228c9 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Created volume successfully. Jul 01 04:21:37 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29" returned: 0 in 0.954s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:37 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 Jul 01 04:21:37 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:37 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7960591e-d120-4885-8d53-ac5cecfa5bfa 1073741824" returned: 0 in 1.027s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:37 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7960591e-d120-4885-8d53-ac5cecfa5bfa {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:37 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7960591e-d120-4885-8d53-ac5cecfa5bfa Jul 01 04:21:37 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:38 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29" returned: 1 in 1.029s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Downloaded image cd3d1578-06fb-4394-a447-fcb3c35bb5c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd3d1578-06fb-4394-a447-fcb3c35bb5c7', 'metadata': {}}])) to volume d63d3bdb-2556-44dc-9d13-efbc3aa2db29 successfully. {{(pid=86177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Temporary image cd3d1578-06fb-4394-a447-fcb3c35bb5c7 for user 2a92ab135d1e4c4780bb900f8f1484e4 is deleted. {{(pid=86177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG cinder.volume.volume_utils [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Marking volume d63d3bdb-2556-44dc-9d13-efbc3aa2db29 as bootable. {{(pid=86177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Copying metadata from image cd3d1578-06fb-4394-a447-fcb3c35bb5c7 to d63d3bdb-2556-44dc-9d13-efbc3aa2db29. {{(pid=86177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Creating volume glance metadata for volume d63d3bdb-2556-44dc-9d13-efbc3aa2db29 backed by image cd3d1578-06fb-4394-a447-fcb3c35bb5c7 with: {'image_id': 'cd3d1578-06fb-4394-a447-fcb3c35bb5c7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2d777d6d9387e4be8408a67c4654fc1e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f68ee5e-9f9a-40c0-8521-043612f1e595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29', 'volume_size': 1, 'image_id': 'cd3d1578-06fb-4394-a447-fcb3c35bb5c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd3d1578-06fb-4394-a447-fcb3c35bb5c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2d777d6d9387e4be8408a67c4654fc1e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fabd4b897d14233817db2ba244a5f61', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f7855c81515411e89986dc14eaf0fecabf8e53b27bb98ffc0b254eb48ba8123c11dba0edb513ec60978065b7e1a4ced481e49f5c3696d28b2881911d94e52a51', 'id': 'cd3d1578-06fb-4394-a447-fcb3c35bb5c7', 'created_at': datetime.datetime(2026, 7, 1, 2, 21, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 1, 2, 21, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd3d1578-06fb-4394-a447-fcb3c35bb5c7/file', 'properties': {}}, 'image_service': }' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da6922e-9811-456f-aed5-511a88d18665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:38 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Volume volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 (d63d3bdb-2556-44dc-9d13-efbc3aa2db29): created successfully Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da6922e-9811-456f-aed5-511a88d18665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Flow 'volume_create_manager' (7a287a06-66ca-43e8-93bb-2782d361aa59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:38 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-2b1b433c-a1be-47dd-8256-88c9ab191e43 tempest-VolumeImageDependencyTests-1191957363 None] Created volume successfully. Jul 01 04:21:38 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7960591e-d120-4885-8d53-ac5cecfa5bfa" returned: 0 in 0.841s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72e5805-3f0a-4cae-99f7-868af77b947b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7960591e-d120-4885-8d53-ac5cecfa5bfa', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb08ffe-9393-430d-914e-a79539d2c532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:38 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Volume volume-7960591e-d120-4885-8d53-ac5cecfa5bfa (7960591e-d120-4885-8d53-ac5cecfa5bfa): created successfully Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb08ffe-9393-430d-914e-a79539d2c532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:38 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Flow 'volume_create_manager' (218f1a25-2a33-4927-af34-8e479c28f8e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:38 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-2c909a77-ee60-4217-95de-4b742bd57010 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Created volume successfully. Jul 01 04:21:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Acquiring lock "cinder-d63d3bdb-2556-44dc-9d13-efbc3aa2db29-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Lock "cinder-d63d3bdb-2556-44dc-9d13-efbc3aa2db29-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Acquiring lock "cinder-quobyte-d63d3bdb-2556-44dc-9d13-efbc3aa2db29" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Lock "cinder-quobyte-d63d3bdb-2556-44dc-9d13-efbc3aa2db29" acquired by "delete_volume" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:39 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d9838a-f34d-499f-a327-50c493d074cb]: (4, 'raw') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:39 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:39 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 Jul 01 04:21:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "cinder-7960591e-d120-4885-8d53-ac5cecfa5bfa-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:39 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:39 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-7960591e-d120-4885-8d53-ac5cecfa5bfa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "cinder-quobyte-7960591e-d120-4885-8d53-ac5cecfa5bfa" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:40 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-7960591e-d120-4885-8d53-ac5cecfa5bfa" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:40 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa9a9a9-a014-4032-8a95-dd0877664810]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7960591e-d120-4885-8d53-ac5cecfa5bfa {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:40 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7960591e-d120-4885-8d53-ac5cecfa5bfa Jul 01 04:21:40 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:40 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29" returned: 0 in 0.916s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:40 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 Jul 01 04:21:40 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:40 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7960591e-d120-4885-8d53-ac5cecfa5bfa" returned: 0 in 0.827s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:40 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7960591e-d120-4885-8d53-ac5cecfa5bfa {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:40 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7960591e-d120-4885-8d53-ac5cecfa5bfa Jul 01 04:21:40 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:41 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29" returned: 1 in 0.857s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29' failed. Not Retrying. {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 01 04:21:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:41 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29 Jul 01 04:21:41 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:41 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7960591e-d120-4885-8d53-ac5cecfa5bfa" returned: 0 in 0.689s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:41 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-7960591e-d120-4885-8d53-ac5cecfa5bfa" released by "delete_volume" :: held 1.576s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:41 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=119,cinder:UPDATE=164,cinder:INSERT=45,cinder:DELETE=14 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:21:41 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:UPDATE=136,cinder:SELECT=123,cinder:DELETE=16,cinder:INSERT=41 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:21:41 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Created reservations ['77610d57-2447-4492-ad30-ba84bb3ac1a8', 'd8dfc41b-d354-4f53-91b9-06156349c8e5', 'c9f6e227-3219-4ba8-9b62-c007e376afc0', 'bd95da11-b7ca-4b65-9ad7-a6a80ed9992c'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:41 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:41 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:41 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:41 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "cinder-3c8fdf62-bb27-4b09-b06e-1b619c1d1975-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-3c8fdf62-bb27-4b09-b06e-1b619c1d1975-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:42 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-d63d3bdb-2556-44dc-9d13-efbc3aa2db29" returned: 0 in 0.839s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "cinder-quobyte-3c8fdf62-bb27-4b09-b06e-1b619c1d1975" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Lock "cinder-quobyte-d63d3bdb-2556-44dc-9d13-efbc3aa2db29" released by "delete_volume" :: held 2.688s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-3c8fdf62-bb27-4b09-b06e-1b619c1d1975" acquired by "delete_volume" :: waited 0.022s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec42fc60-acdf-408b-8f54-34ed96c6f4b2]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Created reservations ['0fed9f52-f4d6-4959-a2f0-1fdc162839f7', '1dbd45bb-c236-45ef-8319-0f37e6834878', 'b79df445-2fe9-42a6-8dd9-78c0f6d4fc65', 'ec95411a-3eca-40f5-9def-8e459654ae26'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:42 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.788s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:42 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Deleted volume successfully. Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:42 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975 Jul 01 04:21:42 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:42 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8c338c9f-d65c-4282-ac94-8ee960d6686c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-7960591e-d120-4885-8d53-ac5cecfa5bfa-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:42 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:42 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:43 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975" returned: 0 in 0.843s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:43 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:43 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.725s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:43 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:43 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Deleted volume successfully. Jul 01 04:21:43 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975 Jul 01 04:21:43 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:43 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8a1d934e-5d8b-4c9b-ad0c-a41fe3b04e37 tempest-VolumeImageDependencyTests-1191957363 None] Lock "cinder-d63d3bdb-2556-44dc-9d13-efbc3aa2db29-delete_volume" released by "delete_volume" :: held 3.693s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:44 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-3c8fdf62-bb27-4b09-b06e-1b619c1d1975" returned: 0 in 0.870s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-3c8fdf62-bb27-4b09-b06e-1b619c1d1975" released by "delete_volume" :: held 1.762s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:44 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Created reservations ['0e067100-adf0-4d14-92ba-02769e6bb9da', '86ff3290-5744-49ac-9787-657593cd69dd', '5ef73717-6c31-4683-a42f-4f8c4da87d98', '55a2bc93-f626-4bce-8d1c-3489df5f2363'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:44 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:44 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:44 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "cinder-75feba61-55dd-44e4-87f1-26dfa7d37514-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-75feba61-55dd-44e4-87f1-26dfa7d37514-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "cinder-quobyte-75feba61-55dd-44e4-87f1-26dfa7d37514" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:44 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-75feba61-55dd-44e4-87f1-26dfa7d37514" acquired by "delete_volume" :: waited 0.027s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:44 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf71c498-2fc8-4c66-834b-de568406873b]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:44 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-75feba61-55dd-44e4-87f1-26dfa7d37514 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:44 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-75feba61-55dd-44e4-87f1-26dfa7d37514 Jul 01 04:21:44 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:45 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.931s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:45 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:45 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Deleted volume successfully. Jul 01 04:21:45 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-70f6e400-0a12-4e7b-a8db-a2514a3de18e tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-3c8fdf62-bb27-4b09-b06e-1b619c1d1975-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:45 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-75feba61-55dd-44e4-87f1-26dfa7d37514" returned: 0 in 1.126s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:45 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-75feba61-55dd-44e4-87f1-26dfa7d37514 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:45 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-75feba61-55dd-44e4-87f1-26dfa7d37514 Jul 01 04:21:45 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:46 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-75feba61-55dd-44e4-87f1-26dfa7d37514" returned: 0 in 0.808s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-75feba61-55dd-44e4-87f1-26dfa7d37514" released by "delete_volume" :: held 2.011s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:46 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Created reservations ['717faf08-e26c-45be-b89b-7b712cf53196', 'b62011a6-1bf1-42a2-942a-a2865d0d4831', '15e09cb8-7e11-492c-a593-b14dab8e3811', 'def02b76-d6b6-4008-afd0-85022e972cf3'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:46 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:46 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:46 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:46 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:46 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "cinder-deb44eb5-9299-4859-97fd-45e4882303f9-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:47 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-deb44eb5-9299-4859-97fd-45e4882303f9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:47 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "cinder-quobyte-deb44eb5-9299-4859-97fd-45e4882303f9" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:47 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-deb44eb5-9299-4859-97fd-45e4882303f9" acquired by "delete_volume" :: waited 0.014s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:47 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65d6168-2f46-4d0c-887a-0834e3ec2334]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-deb44eb5-9299-4859-97fd-45e4882303f9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:47 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-deb44eb5-9299-4859-97fd-45e4882303f9 Jul 01 04:21:47 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:47 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.726s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:47 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:47 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Deleted volume successfully. Jul 01 04:21:47 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-3b8be34e-d390-442c-9b49-d80b69f0cecd tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-75feba61-55dd-44e4-87f1-26dfa7d37514-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:47 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-deb44eb5-9299-4859-97fd-45e4882303f9" returned: 0 in 0.796s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:47 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-deb44eb5-9299-4859-97fd-45e4882303f9 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:47 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-deb44eb5-9299-4859-97fd-45e4882303f9 Jul 01 04:21:47 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:48 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-deb44eb5-9299-4859-97fd-45e4882303f9" returned: 0 in 0.660s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:48 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-deb44eb5-9299-4859-97fd-45e4882303f9" released by "delete_volume" :: held 1.517s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:48 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Created reservations ['76130429-b887-4f48-af80-8e3b3d671fac', 'd8a2fcc3-2696-4e55-9818-f49bb135b2f3', 'e1788c91-1e17-4097-8b7a-da2e96ff2840', 'b5bc8b2e-e149-4d7a-b22e-d38ee3089b89'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:48 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:48 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:48 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:48 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:49 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "cinder-28011b40-87de-4f88-b92a-9f5921cec34b-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:49 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-28011b40-87de-4f88-b92a-9f5921cec34b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:49 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.694s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:49 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:49 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Deleted volume successfully. Jul 01 04:21:49 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "cinder-quobyte-28011b40-87de-4f88-b92a-9f5921cec34b" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:49 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d86ed328-ebc3-442a-83c1-722270213fbb tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-deb44eb5-9299-4859-97fd-45e4882303f9-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:49 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-28011b40-87de-4f88-b92a-9f5921cec34b" acquired by "delete_volume" :: waited 0.039s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:49 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d1df22-c149-4ae2-ab72-9813bed81613]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:49 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28011b40-87de-4f88-b92a-9f5921cec34b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:49 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28011b40-87de-4f88-b92a-9f5921cec34b Jul 01 04:21:49 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:50 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28011b40-87de-4f88-b92a-9f5921cec34b" returned: 0 in 0.798s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28011b40-87de-4f88-b92a-9f5921cec34b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:50 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28011b40-87de-4f88-b92a-9f5921cec34b Jul 01 04:21:50 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Flow 'volume_create_manager' (29f45334-f071-49a9-9855-7e1716234383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039d5dcc-8e13-438a-bae2-4b8948a69183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039d5dcc-8e13-438a-bae2-4b8948a69183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-542371537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9da1b4-8f40-4032-a584-923c2b3e2306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8bcdbe8b8a4f4b8e388725c5389f98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:50Z,use_quota=True,user_id='81694631d71248699039a94b0f9c9c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65661b5d-4164-4c09-b1a0-6d7cc73d70f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65661b5d-4164-4c09-b1a0-6d7cc73d70f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcfa892-5440-4579-9b45-3c74a92fcf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcfa892-5440-4579-9b45-3c74a92fcf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa9da1b4-8f40-4032-a584-923c2b3e2306', 'volume_name': 'volume-aa9da1b4-8f40-4032-a584-923c2b3e2306', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a32f93-f251-4105-b90a-c5ecf6a8cac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a32f93-f251-4105-b90a-c5ecf6a8cac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ced28f-70d9-4c01-9cb0-b2375dad59ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:50 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Volume aa9da1b4-8f40-4032-a584-923c2b3e2306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa9da1b4-8f40-4032-a584-923c2b3e2306', 'volume_size': 1} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-542371537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9da1b4-8f40-4032-a584-923c2b3e2306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8bcdbe8b8a4f4b8e388725c5389f98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:50Z,use_quota=True,user_id='81694631d71248699039a94b0f9c9c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Creating volume aa9da1b4-8f40-4032-a584-923c2b3e2306 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:21:50 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:50 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 1073741824 Jul 01 04:21:50 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:50 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-28011b40-87de-4f88-b92a-9f5921cec34b" returned: 0 in 0.653s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:50 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-28011b40-87de-4f88-b92a-9f5921cec34b" released by "delete_volume" :: held 1.500s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Created reservations ['6eec1944-9265-4862-989b-f5b91d4ef37b', 'ceed31ad-e58f-4944-912c-33f73606413c', 'ed3451fd-9113-4463-9ed4-669991fdc84c', '9bbaa9db-e13f-4012-81de-1d20f5433ce9'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:51 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:51 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:51 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 1073741824" returned: 0 in 0.817s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:51 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 Jul 01 04:21:51 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "cinder-15d81b34-577d-4546-af3b-a2fce54a2df5-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-15d81b34-577d-4546-af3b-a2fce54a2df5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "cinder-quobyte-2bfac725-3d1d-417c-b8f5-f19cce323d2a" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-2bfac725-3d1d-417c-b8f5-f19cce323d2a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "cinder-quobyte-15d81b34-577d-4546-af3b-a2fce54a2df5" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-15d81b34-577d-4546-af3b-a2fce54a2df5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Deleting offline snapshot 15d81b34-577d-4546-af3b-a2fce54a2df5 of volume 2bfac725-3d1d-417c-b8f5-f19cce323d2a {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] snapshot_file for this snap is: volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f546ae1d-d32f-4ca1-85d7-2c5923a73016]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:51 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.688s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:51 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Deleted volume successfully. Jul 01 04:21:51 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-79ebbd04-4330-411b-903c-458488d51e0c tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-28011b40-87de-4f88-b92a-9f5921cec34b-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:51 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5 Jul 01 04:21:51 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:52 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306" returned: 0 in 0.658s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ced28f-70d9-4c01-9cb0-b2375dad59ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9da1b4-8f40-4032-a584-923c2b3e2306', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6b4a62-2604-435f-a469-57c526f0aa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:52 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Volume volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 (aa9da1b4-8f40-4032-a584-923c2b3e2306): created successfully Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6b4a62-2604-435f-a469-57c526f0aa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Flow 'volume_create_manager' (29f45334-f071-49a9-9855-7e1716234383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:52 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d06a0392-ccc2-488e-a3db-06aedfb871d7 tempest-SnapshotDependencyTests-1910930063 None] Created volume successfully. Jul 01 04:21:52 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5" returned: 0 in 0.765s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b082bd-3313-49f8-b87b-3b6ab549bd62]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:52 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a Jul 01 04:21:52 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] Creating offline snapshot 9cae649d-e783-4960-a950-3ae213062c9a of volume aa9da1b4-8f40-4032-a584-923c2b3e2306 {{(pid=86177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d83abce-1551-4e80-b190-96822639e9f4]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:52 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:53 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 Jul 01 04:21:53 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:53 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a" returned: 0 in 0.784s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:53 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5 Jul 01 04:21:53 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:53 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306" returned: 0 in 0.767s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:53 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a 1G {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:53 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a 1G Jul 01 04:21:53 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:54 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5" returned: 0 in 0.739s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:54 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5 Jul 01 04:21:54 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:54 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a 1G" returned: 0 in 0.832s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:54 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a Jul 01 04:21:54 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:54 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:54 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a.15d81b34-577d-4546-af3b-a2fce54a2df5" returned: 0 in 0.652s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-15d81b34-577d-4546-af3b-a2fce54a2df5" released by "_delete_snapshot" :: held 3.055s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-2bfac725-3d1d-417c-b8f5-f19cce323d2a" released by "delete_snapshot" :: held 3.078s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:54 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Created reservations ['7dfc7031-4703-410f-8610-bd7d1cf14859', '22565ad7-22eb-4251-84b1-f22c4e3bd7cf', '493a4788-8315-4c7f-9f8e-7dda2e8513db', '464f764d-2ec8-4260-92cc-3e231da4746c'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:54 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Delete snapshot completed successfully. Jul 01 04:21:54 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-ec61471b-00e5-4b8e-b33f-653ce88268db tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-15d81b34-577d-4546-af3b-a2fce54a2df5-delete_snapshot" released by "delete_snapshot" :: held 3.225s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:55 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 -F qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a" returned: 0 in 0.702s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:55 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a is being set with open permissions: ugo+rw Jul 01 04:21:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:55 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a Jul 01 04:21:55 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:55 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "cinder-2bfac725-3d1d-417c-b8f5-f19cce323d2a-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a" returned: 0 in 0.663s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-2bfac725-3d1d-417c-b8f5-f19cce323d2a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:55 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.info Jul 01 04:21:55 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "cinder-quobyte-2bfac725-3d1d-417c-b8f5-f19cce323d2a" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:55 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-2bfac725-3d1d-417c-b8f5-f19cce323d2a" acquired by "delete_volume" :: waited 0.015s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:55 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d115abd-9e3a-4d09-928a-df72d7bd9b3e]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:55 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:56 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a Jul 01 04:21:56 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:56 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.info" returned: 0 in 0.635s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:56 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.info is being set with open permissions: ugo+rw Jul 01 04:21:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.info {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:56 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.info Jul 01 04:21:56 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:56 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a" returned: 0 in 0.764s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:56 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:56 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a Jul 01 04:21:56 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:57 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.info" returned: 0 in 0.684s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.383s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:57 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-9337a18f-5138-48ac-a0bb-4255bd01eb13 tempest-SnapshotDependencyTests-1910930063 None] Create snapshot completed successfully Jul 01 04:21:57 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2bfac725-3d1d-417c-b8f5-f19cce323d2a" returned: 0 in 0.650s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:57 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-quobyte-2bfac725-3d1d-417c-b8f5-f19cce323d2a" released by "delete_volume" :: held 1.474s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:57 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Created reservations ['8a05bf8e-80ca-4ddb-949e-4d5b7a2b5ac0', '47286b0e-7cb9-4558-b426-4fdc008e98d8', 'aca040a1-6769-484d-85aa-f716e193ac0c', '4a9b131c-1843-4457-9554-5f002b35a1df'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:21:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:57 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:57 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:57 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:57 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:21:57 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:58 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.660s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:21:58 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Deleted volume successfully. Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-db1ccaf4-633b-4979-bed2-9ccbd299f860 tempest-CreateVolumesFromSnapshotTest-1730465588 None] Lock "cinder-2bfac725-3d1d-417c-b8f5-f19cce323d2a-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Flow 'volume_create_manager' (6aede1ab-f2ba-48f2-ba14-833b7b0122c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411471c0-d0be-4236-a61d-caad1cd6b8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411471c0-d0be-4236-a61d-caad1cd6b8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8655af7e-fb65-4a5d-97e1-d6c216e0310b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8bcdbe8b8a4f4b8e388725c5389f98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9cae649d-e783-4960-a950-3ae213062c9a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:21:59Z,use_quota=True,user_id='81694631d71248699039a94b0f9c9c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7300878e-5eb9-42e0-8e4e-bce3290de477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7300878e-5eb9-42e0-8e4e-bce3290de477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3584fb02-8239-47e8-90b3-2a5c93956f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3584fb02-8239-47e8-90b3-2a5c93956f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8655af7e-fb65-4a5d-97e1-d6c216e0310b', 'volume_name': 'volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b', 'volume_size': 1, 'snapshot_id': '9cae649d-e783-4960-a950-3ae213062c9a'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65174a1-d3e4-485c-a69e-a5686f048082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65174a1-d3e4-485c-a69e-a5686f048082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d6f2cd-356c-4e52-88e0-075f397f4071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:21:58 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Volume 8655af7e-fb65-4a5d-97e1-d6c216e0310b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b', 'volume_size': 1, 'snapshot_id': '9cae649d-e783-4960-a950-3ae213062c9a'} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "cinder-quobyte-9cae649d-e783-4960-a950-3ae213062c9a-8655af7e-fb65-4a5d-97e1-d6c216e0310b" by "_create_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-quobyte-9cae649d-e783-4960-a950-3ae213062c9a-8655af7e-fb65-4a5d-97e1-d6c216e0310b" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Creating volume 8655af7e-fb65-4a5d-97e1-d6c216e0310b from snapshot 9cae649d-e783-4960-a950-3ae213062c9a {{(pid=86177) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "cinder-quobyte-8655af7e-fb65-4a5d-97e1-d6c216e0310b" by "_copy_volume_from_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-quobyte-8655af7e-fb65-4a5d-97e1-d6c216e0310b" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] snapshot: 9cae649d-e783-4960-a950-3ae213062c9a, volume: 8655af7e-fb65-4a5d-97e1-d6c216e0310b, {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0c9445-7d7f-4e28-9578-fe661e46f165]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:58 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:59 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a Jul 01 04:21:59 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:21:59 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 01 04:21:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a" returned: 0 in 0.827s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:21:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa9da1b4-8f40-4032-a584-923c2b3e2306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:21:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 01 04:21:59 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Creating direct copy from snapshot {{(pid=86177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 01 04:21:59 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e1b751-ba91-4a11-840b-e53153df329b]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:21:59 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:21:59 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 Jul 01 04:21:59 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:00 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306" returned: 0 in 0.761s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:00 devstack cinder-volume[86177]: DEBUG cinder.utils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Path /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b not found in is_blk_device check {{(pid=86177) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 01 04:22:00 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:00 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b Jul 01 04:22:00 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:01 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:22:01 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Flow 'volume_create_manager' (618a8afc-a1c1-42fe-bc34-e9497ea81a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:22:01 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6396c11-206a-4a91-bd52-7f6333117a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:01 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6396c11-206a-4a91-bd52-7f6333117a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644627490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b21725-f8ea-4d70-95dd-315e3d731569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a1ddd45bac40bea7e0191e6a2890eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:22:01Z,use_quota=True,user_id='522f2c4293744169afccb1949b0be770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:01 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df3b05c-ba04-43a6-a4e1-98c02c889104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:01 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df3b05c-ba04-43a6-a4e1-98c02c889104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:01 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eae284a-a0e3-4b6f-b3ba-cfdbbb10abc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:01 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eae284a-a0e3-4b6f-b3ba-cfdbbb10abc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3b21725-f8ea-4d70-95dd-315e3d731569', 'volume_name': 'volume-f3b21725-f8ea-4d70-95dd-315e3d731569', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:01 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75ac8b5-bfe3-4e37-a265-bc4e3c4eb184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:01 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75ac8b5-bfe3-4e37-a265-bc4e3c4eb184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:01 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3f3b88-76c8-4646-aac4-e4390f3a02ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:01 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume f3b21725-f8ea-4d70-95dd-315e3d731569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3b21725-f8ea-4d70-95dd-315e3d731569', 'volume_size': 1} Jul 01 04:22:01 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:05 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b" returned: 0 in 4.538s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:05 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[37903c70-f358-4e0d-83ec-f46988783dd5]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:22:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:05 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 Jul 01 04:22:05 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:05 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306" returned: 0 in 0.887s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:05 devstack cinder-volume[86177]: DEBUG cinder.image.image_utils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Image conversion details: src /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b {{(pid=86177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 01 04:22:05 devstack cinder-volume[86177]: INFO cinder.image.image_utils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Converted 1024.00 MB image at 225.62 MB/s Jul 01 04:22:05 devstack cinder-volume[86177]: WARNING cinder.volume.drivers.remotefs [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b is being set with open permissions: ugo+rw Jul 01 04:22:05 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:06 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b Jul 01 04:22:06 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:06 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b" returned: 0 in 0.624s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-quobyte-8655af7e-fb65-4a5d-97e1-d6c216e0310b" released by "_copy_volume_from_snapshot" :: held 7.753s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-quobyte-9cae649d-e783-4960-a950-3ae213062c9a-8655af7e-fb65-4a5d-97e1-d6c216e0310b" released by "_create_volume_from_snapshot" :: held 7.797s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.826s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.501s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644627490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b21725-f8ea-4d70-95dd-315e3d731569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a1ddd45bac40bea7e0191e6a2890eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:22:01Z,use_quota=True,user_id='522f2c4293744169afccb1949b0be770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Creating volume f3b21725-f8ea-4d70-95dd-315e3d731569 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:22:06 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3b21725-f8ea-4d70-95dd-315e3d731569 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:06 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3b21725-f8ea-4d70-95dd-315e3d731569 1073741824 Jul 01 04:22:06 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d6f2cd-356c-4e52-88e0-075f397f4071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b', 'volume_size': 1, 'snapshot_id': '9cae649d-e783-4960-a950-3ae213062c9a'}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b64954e-7f27-4293-9f3a-a6a8e1b6b8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:06 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Volume volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b (8655af7e-fb65-4a5d-97e1-d6c216e0310b): created successfully Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b64954e-7f27-4293-9f3a-a6a8e1b6b8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:06 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Flow 'volume_create_manager' (6aede1ab-f2ba-48f2-ba14-833b7b0122c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:22:06 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1cbdf1b6-7d24-46ce-9707-9ad114ac26a1 tempest-SnapshotDependencyTests-1910930063 None] Created volume successfully. Jul 01 04:22:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "cinder-9cae649d-e783-4960-a950-3ae213062c9a-delete_snapshot" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-9cae649d-e783-4960-a950-3ae213062c9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "cinder-quobyte-aa9da1b4-8f40-4032-a584-923c2b3e2306" by "delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-quobyte-aa9da1b4-8f40-4032-a584-923c2b3e2306" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "cinder-quobyte-9cae649d-e783-4960-a950-3ae213062c9a" by "_delete_snapshot" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:07 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-quobyte-9cae649d-e783-4960-a950-3ae213062c9a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:07 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Deleting offline snapshot 9cae649d-e783-4960-a950-3ae213062c9a of volume aa9da1b4-8f40-4032-a584-923c2b3e2306 {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 01 04:22:07 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] snapshot_file for this snap is: volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a {{(pid=86177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 01 04:22:07 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd654b63-df78-4ffa-99c6-a58d1b5b17d9]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:22:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:07 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3b21725-f8ea-4d70-95dd-315e3d731569 1073741824" returned: 0 in 0.862s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:07 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3b21725-f8ea-4d70-95dd-315e3d731569 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:07 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3b21725-f8ea-4d70-95dd-315e3d731569 Jul 01 04:22:07 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:07 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a Jul 01 04:22:07 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:08 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3b21725-f8ea-4d70-95dd-315e3d731569" returned: 0 in 0.648s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:22:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3f3b88-76c8-4646-aac4-e4390f3a02ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b21725-f8ea-4d70-95dd-315e3d731569', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a36833-c510-4b98-91ad-0abf313ce81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:08 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume volume-f3b21725-f8ea-4d70-95dd-315e3d731569 (f3b21725-f8ea-4d70-95dd-315e3d731569): created successfully Jul 01 04:22:08 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a36833-c510-4b98-91ad-0abf313ce81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:08 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Flow 'volume_create_manager' (618a8afc-a1c1-42fe-bc34-e9497ea81a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:22:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a" returned: 0 in 0.755s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:08 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa9da1b4-8f40-4032-a584-923c2b3e2306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 01 04:22:08 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-5370c563-c0c9-47a6-a3a4-1d660456abb2 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Created volume successfully. Jul 01 04:22:08 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecc82be-4522-42f5-a076-571dd7103750]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:22:08 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:08 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 Jul 01 04:22:08 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:09 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306" returned: 0 in 0.780s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Flow 'volume_create_manager' (043b1020-dac3-4591-9202-031e74417fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:22:09 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a Jul 01 04:22:09 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a06df8-9972-4932-98ba-e673d2f07297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a06df8-9972-4932-98ba-e673d2f07297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1257471862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179aab8a-5040-48c3-8b7a-2138771ed95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a1ddd45bac40bea7e0191e6a2890eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:22:09Z,use_quota=True,user_id='522f2c4293744169afccb1949b0be770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7aaf00-e721-4420-912a-6535482b9c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7aaf00-e721-4420-912a-6535482b9c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061f9e5f-08cd-4760-8184-13ab235c1241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061f9e5f-08cd-4760-8184-13ab235c1241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '179aab8a-5040-48c3-8b7a-2138771ed95a', 'volume_name': 'volume-179aab8a-5040-48c3-8b7a-2138771ed95a', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eceef2de-fe7e-4861-a293-b9094a7d7798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eceef2de-fe7e-4861-a293-b9094a7d7798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c132b24-efd3-4be6-b6c6-c541b087155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:09 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume 179aab8a-5040-48c3-8b7a-2138771ed95a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-179aab8a-5040-48c3-8b7a-2138771ed95a', 'volume_size': 1} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1257471862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179aab8a-5040-48c3-8b7a-2138771ed95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a1ddd45bac40bea7e0191e6a2890eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:22:09Z,use_quota=True,user_id='522f2c4293744169afccb1949b0be770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Creating volume 179aab8a-5040-48c3-8b7a-2138771ed95a {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:22:09 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-179aab8a-5040-48c3-8b7a-2138771ed95a 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:09 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-179aab8a-5040-48c3-8b7a-2138771ed95a 1073741824 Jul 01 04:22:09 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Flow 'volume_create_manager' (a0e7a4e8-2942-49ca-9cdd-e88065d0aec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b64a24c-b4c3-49d7-8a0d-d1bea0e66c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b64a24c-b4c3-49d7-8a0d-d1bea0e66c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2145699235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4bdee5-104c-4560-8a65-499572be0686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a1ddd45bac40bea7e0191e6a2890eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:22:09Z,use_quota=True,user_id='522f2c4293744169afccb1949b0be770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3349d3c9-f6ac-4c29-9a0b-0c3b3bfc0776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3349d3c9-f6ac-4c29-9a0b-0c3b3bfc0776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ff6151-194d-4057-85bc-d57d948b332e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ff6151-194d-4057-85bc-d57d948b332e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e4bdee5-104c-4560-8a65-499572be0686', 'volume_name': 'volume-7e4bdee5-104c-4560-8a65-499572be0686', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f8237c-c565-4f73-b78b-137c10520032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f8237c-c565-4f73-b78b-137c10520032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999a93d5-510e-49dc-9a8c-54bc6d91dbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:09 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume 7e4bdee5-104c-4560-8a65-499572be0686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e4bdee5-104c-4560-8a65-499572be0686', 'volume_size': 1} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Flow 'volume_create_manager' (a2136a71-6f77-4fe3-b7b6-a3f7b013de73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d012c8e-7545-4ab3-ba0c-bba7a602154e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d012c8e-7545-4ab3-ba0c-bba7a602154e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1224461033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a370510-3cf3-4a14-a13f-f7a16cc967a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a1ddd45bac40bea7e0191e6a2890eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:22:10Z,use_quota=True,user_id='522f2c4293744169afccb1949b0be770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331a5775-d11a-4535-985b-719b21666d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331a5775-d11a-4535-985b-719b21666d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:09 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ccafde-9ddf-49c8-a9fb-0bd77f167eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ccafde-9ddf-49c8-a9fb-0bd77f167eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a370510-3cf3-4a14-a13f-f7a16cc967a5', 'volume_name': 'volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1e31e8-4391-4e6d-851f-867a71557c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1e31e8-4391-4e6d-851f-867a71557c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eefea97-1347-4554-8972-27d4c90d4c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:10 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume 9a370510-3cf3-4a14-a13f-f7a16cc967a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5', 'volume_size': 1} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:10 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a" returned: 0 in 1.044s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:10 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a Jul 01 04:22:10 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:22:10 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Flow 'volume_create_manager' (4587f7e2-4536-4e59-827c-8e5a07d8362e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d669e87-1bfe-4abc-b0d7-2774608814da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-179aab8a-5040-48c3-8b7a-2138771ed95a 1073741824" returned: 0 in 1.107s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d669e87-1bfe-4abc-b0d7-2774608814da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-37881599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956b14c3-41d1-4e1e-967e-398898f5881a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a1ddd45bac40bea7e0191e6a2890eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:22:10Z,use_quota=True,user_id='522f2c4293744169afccb1949b0be770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a8ac1c-783c-4bd9-930e-bcc61caefc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a8ac1c-783c-4bd9-930e-bcc61caefc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abde5ab9-314a-4ef1-8955-51d40187711f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abde5ab9-314a-4ef1-8955-51d40187711f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '956b14c3-41d1-4e1e-967e-398898f5881a', 'volume_name': 'volume-956b14c3-41d1-4e1e-967e-398898f5881a', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ed4b37-818c-4d65-b847-58c3b186ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ed4b37-818c-4d65-b847-58c3b186ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a662d047-59c5-46bf-af8a-844c5f81167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:10 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume 956b14c3-41d1-4e1e-967e-398898f5881a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-956b14c3-41d1-4e1e-967e-398898f5881a', 'volume_size': 1} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-179aab8a-5040-48c3-8b7a-2138771ed95a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:10 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-179aab8a-5040-48c3-8b7a-2138771ed95a Jul 01 04:22:10 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Flow 'volume_create_manager' (2b8c3f00-da9d-4a31-9172-af1298259278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b241909-816b-49e5-9068-653b5efb23e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b241909-816b-49e5-9068-653b5efb23e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2103021783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3f95c7-ea30-46b1-8d7c-d2263c87acf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a1ddd45bac40bea7e0191e6a2890eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:22:11Z,use_quota=True,user_id='522f2c4293744169afccb1949b0be770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f02da2-8632-47f5-9936-26bb43e8b703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f02da2-8632-47f5-9936-26bb43e8b703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0219978-f46a-493f-8c56-c9ba120f8569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0219978-f46a-493f-8c56-c9ba120f8569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e3f95c7-ea30-46b1-8d7c-d2263c87acf3', 'volume_name': 'volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027883a8-2a97-4fcd-a54b-4fdda1953d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027883a8-2a97-4fcd-a54b-4fdda1953d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81318ddf-d35f-4ecc-bc8e-6cbebc81e362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:10 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume 2e3f95c7-ea30-46b1-8d7c-d2263c87acf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3', 'volume_size': 1} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:10 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306.9cae649d-e783-4960-a950-3ae213062c9a" returned: 0 in 0.817s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-quobyte-9cae649d-e783-4960-a950-3ae213062c9a" released by "_delete_snapshot" :: held 3.494s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-quobyte-aa9da1b4-8f40-4032-a584-923c2b3e2306" released by "delete_snapshot" :: held 3.519s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:10 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Created reservations ['2ef494cf-0bb7-4ecc-b9e2-15ddae9ad2a6', '15f0b1cc-703d-4cd3-ac38-7bcbf66d4877', 'efc26380-f447-4aff-a6f6-b796b749c68e', '371f36a9-b2ad-44d7-be50-59e2477dcf7d'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:22:11 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Delete snapshot completed successfully. Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-1bcba448-4ed6-478d-8ad7-a3d071a1fe79 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-9cae649d-e783-4960-a950-3ae213062c9a-delete_snapshot" released by "delete_snapshot" :: held 3.659s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:11 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-179aab8a-5040-48c3-8b7a-2138771ed95a" returned: 0 in 0.697s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2145699235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4bdee5-104c-4560-8a65-499572be0686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a1ddd45bac40bea7e0191e6a2890eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:22:09Z,use_quota=True,user_id='522f2c4293744169afccb1949b0be770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Creating volume 7e4bdee5-104c-4560-8a65-499572be0686 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:22:11 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7e4bdee5-104c-4560-8a65-499572be0686 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:11 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7e4bdee5-104c-4560-8a65-499572be0686 1073741824 Jul 01 04:22:11 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c132b24-efd3-4be6-b6c6-c541b087155a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179aab8a-5040-48c3-8b7a-2138771ed95a', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c159eee-18c1-4795-aa5f-6d9bebb038d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:11 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume volume-179aab8a-5040-48c3-8b7a-2138771ed95a (179aab8a-5040-48c3-8b7a-2138771ed95a): created successfully Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c159eee-18c1-4795-aa5f-6d9bebb038d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Flow 'volume_create_manager' (043b1020-dac3-4591-9202-031e74417fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:22:11 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-e7f521e6-30c1-474b-a84b-b69f85dbc57d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Created volume successfully. Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "cinder-aa9da1b4-8f40-4032-a584-923c2b3e2306-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-aa9da1b4-8f40-4032-a584-923c2b3e2306-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "cinder-quobyte-aa9da1b4-8f40-4032-a584-923c2b3e2306" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-quobyte-aa9da1b4-8f40-4032-a584-923c2b3e2306" acquired by "delete_volume" :: waited 0.029s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8255ba-f78f-4be8-93ef-4c3ae44c0f5d]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:22:11 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:11 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 Jul 01 04:22:11 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:12 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7e4bdee5-104c-4560-8a65-499572be0686 1073741824" returned: 0 in 0.861s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7e4bdee5-104c-4560-8a65-499572be0686 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:12 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7e4bdee5-104c-4560-8a65-499572be0686 Jul 01 04:22:12 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:12 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306" returned: 0 in 0.772s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:12 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306 Jul 01 04:22:12 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:12 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7e4bdee5-104c-4560-8a65-499572be0686" returned: 0 in 0.665s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.699s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1224461033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a370510-3cf3-4a14-a13f-f7a16cc967a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a1ddd45bac40bea7e0191e6a2890eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:22:10Z,use_quota=True,user_id='522f2c4293744169afccb1949b0be770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Creating volume 9a370510-3cf3-4a14-a13f-f7a16cc967a5 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:22:12 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:12 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5 1073741824 Jul 01 04:22:12 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999a93d5-510e-49dc-9a8c-54bc6d91dbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e4bdee5-104c-4560-8a65-499572be0686', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc95a2f8-002a-42ff-baa6-b53c2a21bee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:12 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume volume-7e4bdee5-104c-4560-8a65-499572be0686 (7e4bdee5-104c-4560-8a65-499572be0686): created successfully Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc95a2f8-002a-42ff-baa6-b53c2a21bee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:12 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Flow 'volume_create_manager' (a0e7a4e8-2942-49ca-9cdd-e88065d0aec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:22:12 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-1635310b-69d6-4694-a78d-2bcbe08b6f65 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Created volume successfully. Jul 01 04:22:13 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-aa9da1b4-8f40-4032-a584-923c2b3e2306" returned: 0 in 0.670s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-quobyte-aa9da1b4-8f40-4032-a584-923c2b3e2306" released by "delete_volume" :: held 1.503s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:13 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Created reservations ['921880a3-e80c-4b6d-bb2a-41267b88baf9', '94f63032-ad8d-4aed-930e-4dfd1bf98949', '4d2e6d47-847a-417a-8c93-3674acc23209', '844acc83-0a86-4ef2-8e97-00e076e7aa59'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:22:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:22:13 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:22:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:13 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:22:13 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:13 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5 1073741824" returned: 0 in 0.841s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:13 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:13 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5 Jul 01 04:22:13 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "cinder-8655af7e-fb65-4a5d-97e1-d6c216e0310b-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:13 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-8655af7e-fb65-4a5d-97e1-d6c216e0310b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:14 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "cinder-quobyte-8655af7e-fb65-4a5d-97e1-d6c216e0310b" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.662s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:22:14 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Deleted volume successfully. Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-quobyte-8655af7e-fb65-4a5d-97e1-d6c216e0310b" acquired by "delete_volume" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-0ab65c3f-6968-47c9-a776-7c462e831857 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-aa9da1b4-8f40-4032-a584-923c2b3e2306-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b503099c-bde7-4a4f-b570-5f261f079a69]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:14 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b Jul 01 04:22:14 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:14 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5" returned: 0 in 0.690s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.885s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-37881599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956b14c3-41d1-4e1e-967e-398898f5881a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a1ddd45bac40bea7e0191e6a2890eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:22:10Z,use_quota=True,user_id='522f2c4293744169afccb1949b0be770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Creating volume 956b14c3-41d1-4e1e-967e-398898f5881a {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:22:14 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-956b14c3-41d1-4e1e-967e-398898f5881a 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eefea97-1347-4554-8972-27d4c90d4c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:14 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-956b14c3-41d1-4e1e-967e-398898f5881a 1073741824 Jul 01 04:22:14 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb9b56d-09cb-464d-b1b1-49eadba199e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:14 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5 (9a370510-3cf3-4a14-a13f-f7a16cc967a5): created successfully Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb9b56d-09cb-464d-b1b1-49eadba199e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Flow 'volume_create_manager' (a2136a71-6f77-4fe3-b7b6-a3f7b013de73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:22:14 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-9dd4b381-7cc2-49fc-abca-47d80d5b4e39 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Created volume successfully. Jul 01 04:22:14 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b" returned: 0 in 0.759s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:14 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:14 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b Jul 01 04:22:14 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:15 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-956b14c3-41d1-4e1e-967e-398898f5881a 1073741824" returned: 0 in 0.833s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-956b14c3-41d1-4e1e-967e-398898f5881a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:15 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-956b14c3-41d1-4e1e-967e-398898f5881a Jul 01 04:22:15 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:15 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-8655af7e-fb65-4a5d-97e1-d6c216e0310b" returned: 0 in 0.653s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-quobyte-8655af7e-fb65-4a5d-97e1-d6c216e0310b" released by "delete_volume" :: held 1.460s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Created reservations ['3b473c48-17e8-4ebd-8382-53c66bbaf342', 'cb2aaf82-f916-4b28-8235-19bf754287c6', 'bf5ee054-f8dd-4f76-94a1-6fedeb879c3f', '76ed527c-c319-40e3-a5e2-a398d9e11516'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:15 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:22:15 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:15 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-956b14c3-41d1-4e1e-967e-398898f5881a" returned: 0 in 0.644s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.039s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-01T02:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2103021783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3f95c7-ea30-46b1-8d7c-d2263c87acf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a1ddd45bac40bea7e0191e6a2890eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-01T02:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-01T02:22:11Z,use_quota=True,user_id='522f2c4293744169afccb1949b0be770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fcc766b-2943-4ba2-85a1-61b977eb0898),volume_type_id=3fcc766b-2943-4ba2-85a1-61b977eb0898)}" {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.remotefs [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Creating volume 2e3f95c7-ea30-46b1-8d7c-d2263c87acf3 {{(pid=86177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Selected osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 as target Quobyte volume. {{(pid=86177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 01 04:22:15 devstack cinder-volume[86177]: INFO cinder.volume.drivers.remotefs [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] casted to osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661 Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3 1073741824 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:15 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3 1073741824 Jul 01 04:22:15 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a662d047-59c5-46bf-af8a-844c5f81167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-956b14c3-41d1-4e1e-967e-398898f5881a', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f9ce23-681f-4b10-ade7-1d20944ffa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:15 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume volume-956b14c3-41d1-4e1e-967e-398898f5881a (956b14c3-41d1-4e1e-967e-398898f5881a): created successfully Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f9ce23-681f-4b10-ade7-1d20944ffa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:15 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Flow 'volume_create_manager' (4587f7e2-4536-4e59-827c-8e5a07d8362e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:22:15 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-83975fff-a2e9-47e2-b861-a55300bb2600 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Created volume successfully. Jul 01 04:22:16 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.690s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:16 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:22:16 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Deleted volume successfully. Jul 01 04:22:16 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-33118a67-84b3-48a2-b84d-c82d56ce0d59 tempest-SnapshotDependencyTests-1910930063 None] Lock "cinder-8655af7e-fb65-4a5d-97e1-d6c216e0310b-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:16 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3 1073741824" returned: 0 in 0.837s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:16 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:16 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3 Jul 01 04:22:16 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:17 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3" returned: 0 in 0.726s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:17 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'} {{(pid=86177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 01 04:22:17 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81318ddf-d35f-4ecc-bc8e-6cbebc81e362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3', 'volume_size': 1}' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720dc09b-11f8-4b28-a207-6d678f5c4a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 01 04:22:17 devstack cinder-volume[86177]: INFO cinder.volume.flows.manager.create_volume [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Volume volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3 (2e3f95c7-ea30-46b1-8d7c-d2263c87acf3): created successfully Jul 01 04:22:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720dc09b-11f8-4b28-a207-6d678f5c4a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86177) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 01 04:22:17 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Flow 'volume_create_manager' (2b8c3f00-da9d-4a31-9172-af1298259278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86177) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 01 04:22:17 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-0e188309-4137-4ec5-8700-cdc403383da3 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Created volume successfully. Jul 01 04:22:18 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "cinder-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:18 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:18 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "cinder-quobyte-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:18 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-quobyte-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3" acquired by "delete_volume" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:18 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8fc849-efcf-4dd6-a21b-fcd8eeef699f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:22:18 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:18 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3 Jul 01 04:22:18 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:19 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3" returned: 0 in 0.925s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:19 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:19 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3 Jul 01 04:22:19 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:20 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3" returned: 0 in 0.676s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-quobyte-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3" released by "delete_volume" :: held 1.643s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:20 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Created reservations ['c9915291-ca4a-4390-ba32-dcf74c76ca40', '0f652d7d-fd3b-4d0b-bb69-18df998c634c', '8026e1ea-fc83-4088-821d-84072852892e', '36a2e0db-6e5c-4fcc-b74f-a4cc159701dc'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:22:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:22:20 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:22:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:20 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:22:20 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "cinder-956b14c3-41d1-4e1e-967e-398898f5881a-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-956b14c3-41d1-4e1e-967e-398898f5881a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "cinder-quobyte-956b14c3-41d1-4e1e-967e-398898f5881a" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:20 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-quobyte-956b14c3-41d1-4e1e-967e-398898f5881a" acquired by "delete_volume" :: waited 0.017s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:20 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0839a2-986b-4eda-ab43-b8aac27cd732]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:22:20 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-956b14c3-41d1-4e1e-967e-398898f5881a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:21 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-956b14c3-41d1-4e1e-967e-398898f5881a Jul 01 04:22:21 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:21 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.697s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:21 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:22:21 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Deleted volume successfully. Jul 01 04:22:21 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-aa7d70a7-2179-41bb-af4e-594aa2229dcb tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-2e3f95c7-ea30-46b1-8d7c-d2263c87acf3-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:21 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-956b14c3-41d1-4e1e-967e-398898f5881a" returned: 0 in 0.816s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:21 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-956b14c3-41d1-4e1e-967e-398898f5881a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:21 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-956b14c3-41d1-4e1e-967e-398898f5881a Jul 01 04:22:21 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:22 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-956b14c3-41d1-4e1e-967e-398898f5881a" returned: 0 in 0.659s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:22 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-quobyte-956b14c3-41d1-4e1e-967e-398898f5881a" released by "delete_volume" :: held 1.533s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:22 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Created reservations ['8db53f84-d6c2-4650-ad59-e95084b5f3ad', 'd9f73127-1b54-477b-a281-12ed6b3495db', '67177dcd-a1e9-46d5-94b8-84b26d9c6d17', '9c76ad51-2faf-454d-ad5a-9a96403947fe'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:22:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:22:22 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:22:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:22 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:22 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:22:22 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "cinder-9a370510-3cf3-4a14-a13f-f7a16cc967a5-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-9a370510-3cf3-4a14-a13f-f7a16cc967a5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "cinder-quobyte-9a370510-3cf3-4a14-a13f-f7a16cc967a5" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-quobyte-9a370510-3cf3-4a14-a13f-f7a16cc967a5" acquired by "delete_volume" :: waited 0.018s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:23 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf08705-b20f-4d58-b2ac-90fbae8878cf]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:22:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:23 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:23 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.720s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:23 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:22:23 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Deleted volume successfully. Jul 01 04:22:23 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5 Jul 01 04:22:23 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:23 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-8e6e02fe-9a54-46bd-96d5-61b8f585b6d6 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-956b14c3-41d1-4e1e-967e-398898f5881a-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:24 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5" returned: 0 in 0.848s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:24 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5 Jul 01 04:22:24 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-51943924-3857-456f-982a-3121be420567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-51943924-3857-456f-982a-3121be420567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:24 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:22:24 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:24 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-9a370510-3cf3-4a14-a13f-f7a16cc967a5" returned: 0 in 0.728s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-quobyte-9a370510-3cf3-4a14-a13f-f7a16cc967a5" released by "delete_volume" :: held 1.627s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Created reservations ['318945cb-3121-4751-8477-dfa1b5009928', 'b578ec26-850f-43dc-89ac-ec826619f603', '9dfaf8ed-67fa-438b-9ec4-0cd584d064e5', 'e47c1c95-bf20-4aa7-a1e4-3a74bf525f62'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:24 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:24 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:22:24 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:25 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-51943924-3857-456f-982a-3121be420567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.695s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-51943924-3857-456f-982a-3121be420567 None None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:22:25 devstack cinder-volume[86177]: DEBUG oslo_service.periodic_task [None req-51943924-3857-456f-982a-3121be420567 None None] Running periodic task VolumeManager._thread_info {{(pid=86177) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 01 04:22:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread count: 29 {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 01 04:22:25 devstack cinder-volume[86177]: DEBUG cinder.volume.manager [None req-51943924-3857-456f-982a-3121be420567 None None] thread info: [<_MainThread(MainThread, started 131727883804800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86177) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 01 04:22:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "cinder-7e4bdee5-104c-4560-8a65-499572be0686-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-7e4bdee5-104c-4560-8a65-499572be0686-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "cinder-quobyte-7e4bdee5-104c-4560-8a65-499572be0686" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-quobyte-7e4bdee5-104c-4560-8a65-499572be0686" acquired by "delete_volume" :: waited 0.014s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:25 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[708bfa6f-8215-4821-9bd0-adb08f26d8e9]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:22:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7e4bdee5-104c-4560-8a65-499572be0686 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:25 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7e4bdee5-104c-4560-8a65-499572be0686 Jul 01 04:22:25 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:25 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:25 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.702s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:25 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:22:25 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Deleted volume successfully. Jul 01 04:22:25 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d45af0d3-3894-46d8-80a1-fe33d2ad7f77 tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-9a370510-3cf3-4a14-a13f-f7a16cc967a5-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:26 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7e4bdee5-104c-4560-8a65-499572be0686" returned: 0 in 0.763s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7e4bdee5-104c-4560-8a65-499572be0686 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:26 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7e4bdee5-104c-4560-8a65-499572be0686 Jul 01 04:22:26 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:26 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:26 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-7e4bdee5-104c-4560-8a65-499572be0686" returned: 0 in 0.649s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:26 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-quobyte-7e4bdee5-104c-4560-8a65-499572be0686" released by "delete_volume" :: held 1.456s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:26 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Created reservations ['e67148ca-c92e-47ef-a2ad-69aaf8fd1128', '930295c5-6a06-4ebf-b15e-25594eca5481', '4efd3d05-e362-4536-bae4-686f9ba65978', 'cc640bdb-e409-4b73-846f-088aeba579e9'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:22:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:22:27 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:22:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:27 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:22:27 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "cinder-179aab8a-5040-48c3-8b7a-2138771ed95a-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-179aab8a-5040-48c3-8b7a-2138771ed95a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "cinder-quobyte-179aab8a-5040-48c3-8b7a-2138771ed95a" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:27 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.655s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:27 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:22:27 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Deleted volume successfully. Jul 01 04:22:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-quobyte-179aab8a-5040-48c3-8b7a-2138771ed95a" acquired by "delete_volume" :: waited 0.019s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:27 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-774d2c33-c786-4e20-a885-a603b61b4c6d tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-7e4bdee5-104c-4560-8a65-499572be0686-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:27 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[23013058-e155-457c-8be7-1f2ac931bc81]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:22:27 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-179aab8a-5040-48c3-8b7a-2138771ed95a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:27 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-179aab8a-5040-48c3-8b7a-2138771ed95a Jul 01 04:22:27 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:28 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-179aab8a-5040-48c3-8b7a-2138771ed95a" returned: 0 in 0.748s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:28 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-179aab8a-5040-48c3-8b7a-2138771ed95a {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:28 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-179aab8a-5040-48c3-8b7a-2138771ed95a Jul 01 04:22:28 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:29 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-179aab8a-5040-48c3-8b7a-2138771ed95a" returned: 0 in 0.641s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-quobyte-179aab8a-5040-48c3-8b7a-2138771ed95a" released by "delete_volume" :: held 1.433s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Created reservations ['74b5a14a-f4f6-418a-8d0e-060e5ede123b', '69ac829a-a91a-4ddd-8d8e-0d144a278394', 'e6a83e74-4707-41b4-9f0b-50614894cce1', '7f4ec14a-3072-47b6-92e2-fe8543a05949'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:29 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:22:29 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "cinder-f3b21725-f8ea-4d70-95dd-315e3d731569-delete_volume" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-f3b21725-f8ea-4d70-95dd-315e3d731569-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "cinder-quobyte-f3b21725-f8ea-4d70-95dd-315e3d731569" by "delete_volume" {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 01 04:22:29 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.671s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:22:29 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Deleted volume successfully. Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-quobyte-f3b21725-f8ea-4d70-95dd-315e3d731569" acquired by "delete_volume" :: waited 0.023s {{(pid=86177) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-d8659e4c-1650-4145-ad7a-71edacf8444e tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-179aab8a-5040-48c3-8b7a-2138771ed95a-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b95fbd-366d-48c0-994a-001977aff43f]: (4, 'qcow2') {{(pid=87433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 01 04:22:29 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3b21725-f8ea-4d70-95dd-315e3d731569 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:30 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3b21725-f8ea-4d70-95dd-315e3d731569 Jul 01 04:22:30 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:30 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3b21725-f8ea-4d70-95dd-315e3d731569" returned: 0 in 0.748s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:30 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3b21725-f8ea-4d70-95dd-315e3d731569 {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:30 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3b21725-f8ea-4d70-95dd-315e3d731569 Jul 01 04:22:30 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:31 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc/volume-f3b21725-f8ea-4d70-95dd-315e3d731569" returned: 0 in 0.638s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:31 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-quobyte-f3b21725-f8ea-4d70-95dd-315e3d731569" released by "delete_volume" :: held 1.427s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:31 devstack cinder-volume[86177]: DEBUG cinder.quota [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Created reservations ['02502713-2f7a-4745-b63b-223cf47ef4af', '7af00d22-f166-4c96-9930-df9ccd0ba495', '60e17e78-7592-44c4-a245-1074741b5725', '2fe0da4f-a8e9-4fe0-917c-66b9c2ee3086'] {{(pid=86177) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 01 04:22:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 01 04:22:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 01 04:22:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661': None} {{(pid=86177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 01 04:22:31 devstack cinder-volume[86177]: DEBUG cinder.volume.drivers.quobyte [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-adcbadac-e9df-4d9c-b6e6-f6db7ba35661'] {{(pid=86177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 01 04:22:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.lockutils [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86177) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 01 04:22:31 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 01 04:22:31 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc Jul 01 04:22:31 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 01 04:22:32 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 01 04:22:32 devstack cinder-volume[86177]: DEBUG oslo_concurrency.processutils [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7b7edad6b7344d4eea72a606394dacbc" returned: 0 in 0.635s {{(pid=86177) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 01 04:22:32 devstack cinder-volume[86177]: DEBUG cinder.manager [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Notifying Schedulers of capabilities ... {{(pid=86177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 01 04:22:32 devstack cinder-volume[86177]: INFO cinder.volume.manager [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Deleted volume successfully. Jul 01 04:22:32 devstack cinder-volume[86177]: DEBUG cinder.coordination [None req-fa9d8235-c01c-422f-a2ab-435f1ece869a tempest-CreateVolumesFromSourceVolumeTest-1328089507 None] Lock "cinder-f3b21725-f8ea-4d70-95dd-315e3d731569-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=86177) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 01 04:22:41 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:INSERT=36,cinder:UPDATE=154,cinder:SELECT=110,cinder:DELETE=12 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 01 04:22:42 devstack cinder-volume[86177]: DEBUG dbcounter [-] [86177] Writing DB stats cinder:SELECT=96,cinder:INSERT=40,cinder:UPDATE=155,cinder:DELETE=12 {{(pid=86177) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}